DOCUMENT RESUME 



ED 355 685 



EC 301 915 



INSTITUTION 

SPONS AGENCY 

PUB DATE 
CONTRACT 
NOTE 

PUB TYPE 

EDRS PRICE 
DESCRIPTORS 



AUTHOR Mellard, Daryl F. ; And Others 

TITLE National Study of High School Programs for 

Handicapped Youth. National High School Project. Vol. 
2: A Quantitative Description of Concepts and 
Practices for Students with Disabilities. 
Kansas Univ., Lawrence. Dept. of Special 
Education. 

Office of Special Education and Rehabilitative 
Services (ED), Washington, DC. 
12 Sep 93 
G008530217 

301p.; For a related document, see ED 29A 3A7. For 
volume I, see ED 31A 918. A part of the National 
Study of High School Programs for Handicapped Youth 
in Transition. 

Reports - Research/Technical (1A3) 
MF01/PC13 Plus Postage. 

'^Administrator Attitudes; ^'^Disabilities; Educational 
Assessment ; ^Educational Practices ; ^Educational 
Quality; Educational Trends; Futures (of Society); 
Higher Education; High Schools; High School Students; 
Mainstreaming; *Preservice Teacher Education; Regular 
and Special Education Relationship;; Special 
Education; Teacher Attitudes ; ^''Teacher 
Characteristics; Teacher Educators; Teacher 
Qualifications; Trend Analysis; Values 

ABSTRACT 

The National High School Project was initiated to 
provide policy makers at the federal, state, and local levels with 
the information needed to design and evaluate the quality of special 
education programs serving youth with mild to moderate disabilities. 
This project report describes the results of a series of five surveys 
which examined multiple perspectives on the desired attributes of 
high school special education programs and staffs. An introductory 
section reviews literature on projected societal trends, ths general 
education initiative in secondary-level special education programs, 
postsecondary transitions, regular education reforms, and teacher 
training. The five surveys, which examined the values of directors of 
special education, superintendents of schools , and preservice teacher 
trainers, and their impacts on special education programs and 
teaching staff are then detailed in five separate sections. These 
surveys addressed: (1) identification of attributes of successful 
high school special education programs, activities of quality special 
education programs, special education teacher attributes, and 
preservice teacher training activities; (2) ranking of the 15 most 
important program and staff attributes by experts in the field of 
special education; (3) weighting of 10 program attributes and 10 
teacher attributes; (4) determination of the utility of program 
activities' impact on special education program attributes; and (5) 
identification of preservice training activities that have the 
greatest utility for developing a defined set of desired teacher 
attributes. A final section of the report reviews issues and trends 
and describes goals for model high school special education programs 
and for teacher education. Appendixes contain the survey form*. 
(Contains 123 references.) (JDD) 



00 



CO 




U.S. oci»AfrriiCMT or coucatiom 

OHc« Of EducatiOAAi R««Mrch and lmprov«m«nl 

EDUCATIONAL RESOURCES INFORMATION 
^ CENTER (ERIC) 

04nis documant hat Man raproducad at 
racaivad from Xh% parton or organixation 

Of»0ir\ctir>g it 

O Mir>or changat hava bean mada to improva 
rapfoduction quality 

• Potntt of vtaw Of optniont statao in thit dOCu* 
mant do not nacattarily raprasent official 
OERI poaition or policy 



^ National Study of High School Programs 
ic for Handicapped Youth 



National High School Project 
Vol 2 

A Quantitative Description of Concepts and 
Practices for Students with Disabilities 



L The University of Kansas 

\^ Department of Special Education 

^ 3150 Haworth Hall 

^ Lawrence, KS 66045-2330 

BEST copy A VME 

O rj 

ERIC " <^ 



National High School Project 
Vol 2 

A Quantitative Description of Concepts and 
Practices for Students with Disabilities 



September 10, 1992 



Dr. Daryl F. Mellard 
Institute for Research in Learning Disabilities 

Dr, Gary M. Clark 
Department of Special Education 

with 

Dr. E. Lara Reduque 
Institute for Research in Learning Disabilities 



University of Kansas 
Lawrence, Kansas 



ERIC 



4^ 



Preface 



Completing this volume of the final report of the National Study of High School 
Programs for Handicapped Students in Transition marks more of a beginning than an end to 
the process of inquiry into secondary special education. What started out as a descriptive study 
of secondary special education ended up a complex series of studies that were extremely 
difficult to interpret and report. We wanted to describe the status of secondary special 
education in terms of current programming for students with mild to moderate disabilities 
and the characteristics or attributes which distinguished a good secondary program. We hoped 
to put that information into some overall context that fit with the project's other two major 
components: State Graduation Policies and P rogram Practices Related to High School Sppnal 
Education Programs (Bodner, Clark, & Mellard, 1987) and National Study of High ScVnnl 
Programs for Handicanned Youth in Transition, VoL 1: Qualitative nomponpnt (Knowlton & 
Clark, 1989). 

As you will understand when you move through this document, some of what we found 
in the study was disturbing. We had to ask ourselves some hard questions: In an era of 
outcomes education, how is it possible for administrators and pre-service teacher trainers who 
influence policy and practice in special education programs to value program and teacher 
attributes of legal compliance and traditional rhetoric more highly than outcomes in 
student/graduate behaviors or the substantive focus of teachers' knowledge and skills related 
to student outcomes? Is this the state of the art or did we pose our questions in such a manner 
that they permitted some bizarre distortion of reality? 

Given our dilemma for interpreting the mass of data, we believed it was important to 
present a strong case for how and what we did so that readers can participate in that 
interpretative process. Each study is presented with a rationale for our procedures and how the 
results of each fit with what we understood about the field. This process resulted in a very 
comprehensive report. The final chapter provides a summary to each of the studies and raises 
implications for new beginnings for the field. 

We would like to acknowledge those individuals who assisted us and express 
appreciation to them. Special thanks go to Dr. Lara Reduque, Dr. H. Earle Knowlton, Dr. Don 
Dorsey, Dr. Steve Maynard- l.loody, Yukihiro Yumitani, Joanne Bodner, and Jane Schrepel- 
Boldt. 
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Preparation of this document was supported by Grant No. GOO8530217, Office of Special Education and 
Rehabilitative Services, U. S. Department of Education, However, the opinions expressed herein do not 
necessarily reflect the position or policy of the U. S. Department of Education; no ofBcial endorsement by 
the U. S. Department of Education should be inferred. 
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National High School Project: 

Vol 2y A Quantitative Description of Concepts and 
Practices for Students 
with Disabilities 



Introduction 

Not providing [secondary education for handicapped 
students] is not simply a planned or unplanned neglect 
of those students. It is in large part the result of a lack 
of available secondary education programs, and even before 
that a gap in our knowledge about how to design those programs 

(OSERS, 1984). 

The National High School Project was initiated to provide policy makers at the federal, 
state, and local levels with information to design and evaluate the quality of special education 
programs serving youth with mild to moderate handicaps. Three major research efforts were 
completed as part of the National High School Project. This report describes the results of a 
series of five surveys which examined multiple perspectives on the desired attributes of high 
school special education programs and staffs. Knowlton and Clark (1989) and Bodner, Clark, 
and Mellard (1987) described the other two research projects. Utilizing a qualitative research 
methodology, Knowlton and Clark (1989) reported four case studies of school districts which 
examined the goals, current practices and barriers to the delivery of special education programs 
at the secondary level. Bodner et al. (1987) reported the results of a nation-wide survey of state 
departiiicnts of education concerning graduation requirements, teacher certification 
requirements, minimal competency testing, and statewide trends in secondary level special 
education, e.g., awarding diplomas and transition plans. These combined reports provide 
integrated: multi-faceted perspectives on high schools' special education programs. 

An issue which continually receives much attention but little substantive work concerns 
quality of education. Indeed, recent discussions have highlighted the perception that the 
discussion of quality is itself a shifl in focus from two previous educational themes: efficiency, a 
dominant theme initiated in the 1920s, and equity, an emerging theme of the 1950s (Mitchell & 
Encarnation, 1984). In the context of the article, Mitchell and Encamation argiie that quality 
issues are emerging as the emphasis on accountability is directed towards the outcomes of 
students' formal educational experiences. Examination of secondary level special education 
programs for students with mild to moderate handicaps is briefly included in these discussions 
on the quality of education. However, as a subset of the general student population, the history 
of secondary level special education programs is relatively brief and the current state is only 
meagerly described. The National High School Project was designed to address .ssues in 
providing quality educational programs for students with mild to moderate handicaps. 

Project goals. The goals of the National High School Project were fourfold: 1) to describe 
the desired qualities characterizing special education programs for high scNool students with 
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mild to moderate handicaps; 2) to offer recommendations for future directions in developing such 
programs; 3) to describe the desired qualities characterizing the teexhing staff of special 
education programs for high school students with mild to moderate handicaps; and 4) to offer 
recommendations for pre-service teacher training programs. A variety of groups or stakeholders 
have interests and viewpoints in both maintaining and directing the future of both programs and 
staffs. In acknowledging this situation's realities, the research methodology was chosen to 
represent those alternative viewpoints as expressed by directors of special education, 
superintendents of schools, and pre-service teacher trainers. While they are only some of the 
decision makers involved in educational policy, administration, and instruction, they have major 
stakeholder roles. 

Intended reader. A number of audiences will have an interest in this report. At a local 
level, school district administrators and, perhaps more especially, the directors of special 
education can examine this report as a basis for evaluating their own programs and planning 
future directions. Local school district patrons and practitioners may also be inclined to consider 
the information for evaluating how their districts' services fare in comparison to a broader set of 
programs nationally. Specific information is reported which permits a comparison of a local 
district's curricular activities with those activities identified nationally. 

Among state and federal level policy makers the report will have value in examining 
broader issues such as legislative and regulatory policies and statutes. A sense of security has 
developed in the general public that recent reforms since the release of A Nation at Risk (USDE, 
1983) have lessened the crisis stage. This report provides a reappraisal of whether the optimism 
is warranted. 

Those members of national organizations who are actively involved in charting their 
organization's goals might be interested in reviewing these data. Specifically, groups such as the 
National Association of State Directors of Special Education, National Association of Secondary 
School Principals, and National Association of School Boards, quite likely, will discern some 
relevant and appropriate organizational goals. 

College and university faculty involved in teacher training programs should have a special 
interest in examining the information regarding desired qualities of special education programs 
and teaching staffs. The Teacher Education Division - Coxancil for Exceptional Children is the 
primary target audience, but collaborating organizations controlling teacher education policies 
include the American Association of Colleges of Teacher Education and National Council for 
Accreditation of Teacher Education. 

Report overview. Grounded in the project's stated purpose, this report is organized to 
describe the background, methods, results, and conclusions of this part of the project. The next 
several paragraphs provide greater detail about the organization of the report's content. In this 
background section, titled "Future Scenarios," recent literature is reviewed with respect to a 
future perspective of Anierican society. This perspective of future society is not intended as a 
comprehensive treatment, but to emphasize others' observations deemed relevant to this project. 
Such information is relevant as a context in which the project's data and others' 
recommendations for reform in both regular and special education can be considered. 

Following the review of projected societal trends, the literature on secondary level special 
education programs and current reforms is presented. In special education programs, two topics 
dominate: post-secondary transition and the general education initiative. Both of these topics 
are reviewed. However, special education is only a small segment of the total high school 
education program. Given the broader curricular and administrative context within which 
special education exists, recent trends and reforms in regular education are reviewed. Current 
trends reflect both an established ritual of reform movements (Combleth, 1986) and recent 
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differences in the federal government's educational philosophy (Clark & Astuto, 1986; Reid, 
1987; and Resnick & Resnick, 1985). 

Special education's triumphs and ailments parallel those of regular education. Curricular 
programing and its revisions are also generally concurrent with or followed by calls for reform in 
teacher education. The parallels between teacher reform in special education and regular 
education are described in a later section of the report. The reader may consider this information 
as peripheral to describing the qualities of special education programs and teaching staff. 
However, without this contextual foundation, the surveys-appear as little more than one-shot 
studies contributing little beyond the static results captured by a particular methodology. Since 
teachers have the primary instructional responsibility, issues of training teachers are ver>' 
important. 

A multi-attribute utility measurement (MAUM) methodology (Edwards, 1977) was adopted 
to capture the value systems of current policies and goals. MAUM begins with an assumption 
that alternative choices and decisions are based on balancing particular values. The values of 
three groups were examined in this project: directors of special education, superintendents of 
schools, and pre-service teacher trainers. The MAUM procedures were adopted to elicit these 
groups' values which are the basis for decisions and the desired outcomes. We believe that some 
of the confusion in education programs are attributable to differences of values and that to 
understand the decisions and activities in education, one must also understand the values which 
drive those decisions. Similarly, those values are likely to change, perhaps due to such forces as 
economics and changing demographics. The MAUM procedures provide an opportunity to 
describe current value systems and their impacts on special education programs and teaching 
staff. In this project, the values were identified as the particular attributes desired in special 
education programs and teaching staff. The choices or decisions corresponded to the activities 
which are part of high school special education rrograms and pre-service teacher training 
programs. The activities are the means to the end, i.e., the choices one makes to reach a 
specified goal. Thus, the final results of the; project are specifications of the goals or desired 
attributes of special education programs and their teaching staff by three stakeholder groups and 
the activities which they believe have the greatest utility for maximizing those goals. 

Each of the five surveys is reviewed. A brief introduction of the relevant published 
literature is provided as a context for each particular survey. The survey's procedures and 
results are provided. The findings are briefly discussed in the context of the literature which was 
cited and the other aspects of the project such as the relationship with the other surveys 
completed, the qualitative research case studies (Knowlton & Clark, 1989) and the Bodner et al. 
(1987) results. 

The last section of this report combines the common threads from this part of the NHS 
project and the current literature. Issues and trends are reviewed and goals for a model for high 
school special education programs are described. Similarly, for pre-ser^^ce teacher training, 
issues are reviewed and options for training models are proposed. As stated previously, the next 
section begins with a brief review of published literature concerning future scenarios of American 
society. This information will assist the reader in further evaluating appropriate attributes and 
curricular activities in special education programs. 

Future Scenarios 

Some high school students with handicaps receive the majority of their academic and 
vocational education through special education programs. Others receive the majority of theirs 
in regular, mainstream programs. In either situation, someone has the full responsibility of 
preparing each handicapped student to be a knowledgeable citizen and contributing member of 
society. The roles of an individual include at least a minimal degree of independent functioning, 
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of living in a community setting, of participating in commuinity activities, and of working in a 
competitive setting. A review of possible future scenarios provides a standard of how both 
regular and special education might benefit students with disabilities. If one can glimpse the 
future, one potentially can prepare in advance. These glimpses of the future were prepared from 
three sources: a paper in 1985 by Harold Hodgkinson titled "All One System: Demographics of 
Education," a 1987 report from William Johnston and Arnold Packer at the Hudson Institute 
titled Workforce 2000, and an article in Education Week^ "Reform at 5: The Unfinished Agenda" 
by M. Sandra Reeves (Reeves, 1988). These papers reviewed current economic, social, 
educational, and occupational issues and shifts that might be expected in the near future. 

Halloran, Thomas, Snauwaert, and Destefano (1987) reported that occupational 
opportunities for persons with handicaps are minimal. They estimated that approximately 67 
percent of those Americans with handicaps between the ages o. 16 and 64 are not working. 
Similar conclusions were drawn in separate studies by Hasazi, Gordon, and Roe (1985) and 
Mithaug, Horiuchi, and Fanning (1985). Optimism for improving on that figure hardly seems 
justified. Perhaps the best approach for reducing that figure would result from declaring that 
the handicapped population has reduced in size. Several futurists have suggested that quite 
dramatic shifls are expected in the occupational opportunities. These shifts are not likely to 
benefit the population with disabilities. For example, all new jobs are expected to require post- 
secondary training. Manufacturing jobs will decrease while service jobs will increase. The 
complexity of jobs will place increasing demands on an employee's preparation in reading, 
following directions, applied reasoning, and using mathematics. "When jobs are given numerical 
ratings according u) the math, language, and reasoning skills they require, only twenty-seven 
percent of all new jobs fall into the lowest two skill categories, while 40 percent of current jobs 
require these limited skills" (Johnston & Packer, 1987, p. xxi). An expected consequence is that 
unemployment rates will increase among those persons with limited skills, while the rates will 
decrease among persons with advantaged skills. 

Thus, a significant dilemma confronts the policy groups and practitioners who shape 
educational practices. On the one hand, improved academic skills arp ^^early needed for 
maintaining occupational options, and yet students with mild ha . icaps have a history of low 
academic achievement and generally poor performance in otb*^*" ^ ad indices of successful school 
behaviors, e.g., study skills, notetaking skills, test taking l«.>. ^, istening comprehension, and so 
on. Coupled with these skill and content deficits, students with mild handicaps are not so likely 
to "feel good" about the prospects of not only more itcademic education, but a more rigorous 
academic education. Academic domains should not be the sole focus of students' educational 
programs, however. The task of providing an appropriate education must also address those 
other non-academic aspects of schooling that result in outcome behaviors related to adult living. 

Reeves' (1988) review indicated that some visions of the future warn that focusing solely on 
academic skills is itself shortsighted. This shortsighted view is based on a premise that a 
comparatively small number of jobs are highly academic in skill content and requirements. 
Other curricular content is also needed. Reeves cited the work of others who have emphasized 
that interpersonal skills, and the ability to learn rapidly and continuously on the job are critical. 
Based on this perspective, schools are encouraged to adopt curricular approaches that foster 
collaborative techniques and working within groups. Mithaug, Martin and Agran (1987) 
reported that even currently the inability tc maintain acceptable performance standards is often 
the cause of job terminations for students with disabilities. An additional curricular approach is 
providing students with the skills to learn on their own. This curriculum might be thought of as 
strategies which a student might use to solve new social, occupational, and daily living problems. 
Several learning strategies approaches have been developed (e.g., Dansereau, 1978; Deshler & 
Schumaker, 1986; Deshler, Schumaker, Alley, Warner & Clark, 1981; Ellis, 1986; Wong, 1985). 
These approaches might have greater utility as society diversifies. 



NHS Tech Report Intro 8/9/92 



ERIC 



In addition to occupational change, the social picture of society will change through 
changes in age, race, and family structure patterns. The median age is currently 30. In the next 
decade the median will rise to 35 and in three decades it will be 40. The population will be older, 
which has implications for who will be in the workforce and attending and supporting the 
educational programs. While the population is aging, its racial composition is also changing in 
that birthrates among whites are decreasing, but increasing for Hispanics and Blacks. The 
population will be more racially and ethnically diverse. Family child-rearing patterns are 
changing. (Hodgkinson, 1985). Hodgkinson estimates that every day 40 teenagers give birth to 
their third child. Divorce rates are increasing and even in two-parent families, increasing 
numbers of both parents are working outside the home. However, most pension, fringe benefits, 
and welfare plans were designed for different family patterns and roles, i.e., men working and 
women staying at home (Johnston & Packer, 1987). These observations and projections have a 
variety of implications for schools and other civic and social institutions. 

Hodgkinson (1985) stated that by the year 2000, one of three people in the United States 
will be from a minority group. The increased racial and ethnic diversity and their increased 
proportional representation in the population have implications for all of education, but 
especially among students with disabilities. One would be naive to ignore the plethora of issues 
associated with the prevalence of disabilities among minority groups. The numbers have an 
obvious impact. A disproportionate number of minority group members report having 
disabilities (Bowe, 1985). Yet, another error would be in assuming that minority group issues 
are comparable across all minority groups. For example, the issues confronted by Spanish- 
speaking immigrants are different from those of Spanish-speaking non-immigrants. Other 
factors than language must be considered. Frequently, the common denominator may be 
poverty, but family attitudes, that is, the parents' own level of education, their valuing of 
education, educational aspirations, and assistance to th^ir children differ, and thus require a 
differential response (Ogbu, 1988). Hence, educational responses to disabilities could be optimal, 
and nonetheless, the results would be unsuccessful. The total approach of institutions' 
assistance must include those affective factors which are potentially as devastating as is the 
classified disability itself. 

This description of societal trends has been included to help focus the discussion about 
appropriate and meaningful reforms. With this brief description of only some of the complex 
societal influences on the near future, one might ask how special education programs, and more 
specifically, how students with mild to moderate handicaps will participate and contribute. 
These students might easily be perceived as a segment of a much larger group of students 
considered "at risk" (Reeves, 1988) due to economic, attitudinal, historical, and educational 
factors. Quite likely when students impacted by these other factors are considered, the students 
with disabilities comprise a proportionately small segment of all students experiencing low 
achievement. The issue then is one of resource allocation. What are the values for allocating 
limited educational resources? For example, how does one equitably distribute resources among 
those groups recognized as having greater needs? How are the values of "need," "equality," and 
"efficiency" considered or weighted in these decisions? How and to what extent is society "better" 
for assisting those individuals with presumed intrinsic disabilities versus assisting those with 
disabilities due to environmental factors and who are, arguably, "more remediable?" 

From another angle, one of the apparent issues is that given the increased competition for 
a reduced number of suitable vocational opportunities, the students with identified disabilities 
will have even greater difficulties meeting job requirements. The label of "special education 
program participant" or "lEP student" might be considered even more disadvantageous than 
having a transcript indicating poor achievement in regular education. What are the utilities in 
special education placements? The answers to such serious, value-laden questions will be found 
by stakeholders involved in education at various levels, e.g., parents, teachers, administrators, 
school boards, regulatory agencies, and governing bodies such as the legislature and executive 
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branches. The decisions may or may not be made consciously or following public debates. That 
is, the discussions may not explicitly include the previous questions or values, but provide a 
narrow focus of values. Those values or underlying assumptions may be addressed indirectly or 
subtly in such activities as selecting textbooks and/or program objectives. As a recent example. 
Gene Glass (1987) reviewed the U.S. Department of Education's What Works: Research About 
Teaching and Learning (1986) and charged that the previous administration s recommendations 
for improving teaching and student achievement represented careful value judgments. These 
value positions discounted or even ignored opposing data, which represented alternative values. 
The issues of curricular options, service delivery models, and of linking values to decisions in 
such areas should be considered as the reader examines the following section in which reforms in 
secondary level special education programs are presented. 

Secondary Level Special Education Programs 

In the preceding section, information was presented regarding changing characteristics in 
basic trends of American society. In this section, issues of special education reform and 
recommended reforms are presented. Special education is not lacking in reforms or reformers. 
Neither is regular education. The reader is invited to consider these reforms not only from the 
perspective of current practices and the changes needed, but also, and perhaps more importantly, 
with the \ erspective of how the future scenarios previously described fit with the reforms: Are 
the reforms meaningful in light of the projected future issues confronting society? To what 
extent do the proposed reforms address current problems, but yet not respond to the next 
decades' issues? What assumptions are made about individual worth? What outcomes are 
valued? 

Two themes dominate calls for reform in special education. The first concerns the 
increased integration of special and regular education, particularly for students considered as 
having mild handicaps. This reform has been referred to as the Regular or General Education 
Initiative. The second theme is the improvement of quality of special education services as 
students transition from high school to independent adult living. This reform has been called the 
transition movement. The perceived similarity or comparability between these two movements 
is a concern for better integration of the special education student into the mainstream of 
academic, social, and vocational activities. However, the two movements are not necessarily 
complementary to or conditional on the other. For example, improved transition services do not 
require increased integration of special and regular education. On the contrary, one might 
envision some scenarios in which increased integration impedes transition services. One can 
question the extent to which the general high school curriculum prepares individual students for 
successful independent living, particularly those students in the lower quartile of achievement. 
Background information is provided in the following paragraphs for understanding linkages with 
this project and these two reform areas. 

Regular education initiative. Reynolds, Wang, and Walberg (1987) have challenged current 
educational practices in two areas: 1) the extent to which special education services are needed 
for many of the students receiving them and 2) the manner in which those services have been 
delivered. They believe that more than three-fourths of the students in special education, those 
students considered as exhibiting mild handicaps, should be integrated into regular education. 
Special education s current provision of educational and related services is seen as a problem 
rather than a solution. The authors do not deny the severity of the students' needs for 
assistance, but rather the delivery of those services is the concern. They view the categorical 
programs as producing disjointed services and excessive proceduralism. 

An example of disjointed services is when students who fail to meet the special education 
eligibility requirements are not treated differently in the schools. For most students, differential 
treatment comes only through placement in special education programs. If the student 



KHS Tech Report Intro 8/9/92 

IS 



encountering academic or behavioral difficulties does not qualify for a special education category, 
no alternative services or considerat* ons are made. Prom this perspective the student's failure to 
meet the requirements of a categorical model results in a denial of services or differential 
treatment. The problem is perceived as a student problem rather than a failure of any 
educational system component In general, special education services have been portrayed as 
creating two systems of education or more poignantly, two types of students, the regular or 
general student and the special education student (Hagerty & Abramson, 1987). In regular 
education, students must fit the prevailing classroom management style which includes loosely 
defined behavioral and academic standards. If the student does not meet these classroom level 
standards, the preferred option is to initiate a referral for special education comprehensive 
evaluation. In fact the referral is commonly considered as the last act of formal responsibility 
identified with regular education. In this manner the regular classroom has been relieved of its 
responsibility for all students. Students move out of regular education into special education on 
parameters defined by regular education. Thus, special education has become the dumping 
ground for poorly performing students (Knowlton & Clark, 1989). 

Following from this basis for special education, the reports that many of the students in 
special education are "mildly handicapped" should come as no surprise (Hagerty & Abramson, 
1987; Sansone, 1987; Shephard, 1987; Ysseldyke, 1983; Ysseldyke, Algozinne, Shinn, & McGue, 
1982). Their assessed handicap is that they do not meet the classroom norm and score in the 
lower normal range of individual differences. Low scores occur any time that a heterogeneous 
group, e.g., all children of a particular age, is organized for administrative convenience and 
assessed on a common measure. In this instance, the organization is in a classroom within a 
school. The administrative organization assumes and acts on the premise that little variance 
exists within the population. 

The second challenge concerns the adequacy of the services, particularly for the mildly 
handicapped. Given the characteristics of these mildly handicapped students, Hagerty and 
Abramson (1987) and Shephard (1987) concluded that the efficacy of special education is not 
likely to be as good as hoped. Some research suggests that the methods are not distinctive, nor 
individually tailored. Stainback and Stainback (1984) offered a similar assessment of special 
education's efficac}' and the need to reconsider the best alternatives of responding to student 
problems. Their proposal was a merger of special and general education back into the one 
system which was first initiated. 

Reynolds et al. (1987) proposed a two-part initiative to redress these issues: 

The first part of the initiative involves the joining of demonstrably effective practices from 
special, compensatory, and general education to establish a general education system that 
is more inclusive and that better serves all students, particularly those who require 
greater-than-usual educational support. The second part of the initiative calls for the 
federal government to collaborate with a number of states and local school districts in 
encouraging and supporting experimental trials of integrated forms of education for 
students who are currently segregated for service in separate special, remedial, and 
compensatory education programs, (p. 394) 

Reynolds et al. (1987) viewed this initiative as increasing acountability as well as 
ensuring that the categories of "new morbidities," are assis^ted. These categories include 
students whose academic difficulties stem from drug use, teenage pregnancy, poor academic 
motivation, and school absence. One consequence is that the plethora of categories may prompt 
some educators to consider individualizing instruction according to the needs of students in 
contrast to the organization of the curriculum (Putnam, 1987). The reader is reminded of the 
preceding section concerning the future demographics of society. The question might also be 
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asked if creating additional, different categories will result in special curricula or other 
treatment, which once again distinguishes the mainstream students from the special students. 

Gartner (1987) offered similar observations as those of Reynolds et al. (1987) and 
Stainback and Stainback (1984) with the added dimension of consequences commonly associated 
with handicaps. One consequence is the development of a separate and segregated education 
system considered secorai class. He and others (Braaten & Braaten, 1988; Lilly, 1987; Pugach & 
Shevin-Sapon; 1987; Shephard, 1987 ) have noted that this separateness is in part evidenced by 
the reports recommending general education reform, but which ignore students in special 
education and other low achieving groups. However, an alternative explanation might be 
suitable. Isn't it reasonable that the omission reflected a lack of knowledge or experience with 
special education? Is it possible that given the relative small size of special education, the 
reformers judged it as insignificant in comparison to broader educational issues? The 
separateness of special education services may not be handicapping, but rather a distinguishing 
asset which results in greater individualization of assessment, planning, instruction, and 
tailored outcomes. 

Another of Gartner's (1987) observations was noting the persistent public attitude that 
students with disabilities are unable to leam. This attitude has stronger implications for 
society's response than does the student's actual functional limitations. Thomas and Halloran 
(1987) described how these perceptions present educational as well as employment issues. A 
parallel situation can be made from differing viewpoints in test score interpretations and bias. 
As Flaugher (1978) noted, one's interpretive viewpoint influences one's consideration of bias. If 
students with disabilities are viewed as lacking the abilities or capacity to learn and that those 
capacities are relatively fixed, few resources are likely to be expended. In contrast, if the 
disabilities are viewed somewhat like low achievement, which can be improved with a variety of 
remediations, the chosen policy might be the one which is directed at fixing the disability. Thus, 
expenditures are considered as having a greater potential impact. 

In summary, the reforms directed towards greater integration of regular education and 
special education have a basic premise that all students would be better served, that the 
categorical approach of special education lends itself to maintaining attitudes which handicap 
special education participants more than do the students' actual disabilities, and that the 
education system would thus have greater, more clearly defined accountability. These 
arguments for the regular education initiative have an intuitive appeal. However, those 
arguments also raise many fears. Quite simply, if the services for these students currently in 
special education are considered as having little impact, little hope is offered that regular 
education will improve the situation (DLD, 1986; Edgar, 1987; McCarthy, 1987; Sargent, 1989). 
The question asked is: To what degree can reintroduction of those students in a system which 
initially rejected them as being too different, likely be beneficial? Similarly, an overriding issue 
in any aspect of education is accountability. Thus, what mechanisms will be used in response to 
education's new responsibilities for students with mild handicaps when education has not been 
accountable with a more select grouping of the general student population? 

Issues posed by the advocates of the regular education initiative have raised the level of 
discussion about the purposes of entitlement programs and the value of research in directing 
policy decisions. Recent issues of Exceptional Children (October, 1988), Journal of Learning 
Disabilities (January, 1988), and Learning Disabilities Focus (Fall, 1988) have published a 
variety of perspectives on the regular education initiative (Bryan, Bay, & Donahue, 1988; 
Kauffman, (Berber, & Semmel, 1988; Keogh, 1988a; 1988b; McKinney & Hocutt, 1988a; 1988b; 
Schumaker & Deshler, 1988) and on methodological issues of its research base (Bryan & Bryan, 
1988; Fuchs & Fuchs, 1988; Hallahan, Keller, McKinney, Lloyd, & Bryan, 1988; Lloyd, Crowley, 
Kohler, & Strain, 1988). The result was a clearer delineation of the alternative perspectives. 
The scope of those issues is beyond the range which could be adequately integrated into this 
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paper, but the importance of the topic necessitates that the content be considered if the reader is 
to have an informed judgment of the regular education initiative. 

The linkage between the regular education initiative and this research effort is quite 
straightforward. The research effort was designed to identify those attributes and activities 
useful for distinguishing the quality of special education programs and teaching staffs. The 
degree to which those perceived qualities match or are reflected in a regular education program 
is an index of its compatibility for educating students evidencing mild to moderate academic and 
behavioral differences. If regular education programs are to be responsive to these students' 
needs, the programs must address the perceived attributes needed in special education. Or, 
stated another way, this project identified those attributes and instructional activities on which 
one could judge the quality of special education services. Thus, these attributes and activities 
provide a framework for judging how well special education meets students' identified needs. 
The students' needs might be thought of as a constant, and the attributes and activities are also 
a constant. Whether these students' needs can be met with at least the same quality level in 
regular education as in special education is a key question for inquiry. Thus, while the regular 
education initiative might be considered as a philosophical argument, the implementation issues 
must also be considered. This research project has established conceptual categories for 
assessing the qualities of existing programs and judging the extent to which students' needs are 
accommodated. 

Transitio n movement . For most students in special education programs, the completion of 
their high school program is the last of their formal school experience. If they receive additional 
training, that training is usually job related and is provided by the employer. Thus, high school 
is the last opportunity for most students to obtain formal instruction in content areas and skills 
which are not specific to a particular job. The thrust of the transition reforms has been to 
examine the efficacy of high school prc^ams and to demonstrate alternative efficacious 
instructional curricula and models. Many alternatives have been provided. The April, 1987 
issue of Exceptional Children was focused specifically on a review of general transition issues. In 
this report, the focus is less on transition delivery models and more on the curricular content, or 
goals that make up the school-based component of such programs, 

Edgar (1987) posed a serious dilemma for secondary level policy makers and practitioners. 
His review of secondary level programs concluded that the curriculum appears to have little, if 
any, impact on students' eventual adjustment to community life. The factors which did make a 
difference were the students' ability levels, family characteristics, or other non-school-related 
factors. He reviewed the dropout rates among students with mild to moderate handicaps and 
found that over 30 percent dropped out. Of those students who completed high school only 15 
percent obtained employment with salaries above the minimum wage. These numerical values 
are interpreted as a crisis situation, one which requires a major change in secondary level special 
education programs. The radical change he advocates is for a curricular shift from academics to 
functional, vocational, and independent living skills. He views the academic emphasis in special 
education as the causative agent in the dropout rate and low employment status among students 
in special education. 

This shift in curricular emphasis is the basis for the dilemma. The anticipated 
consequences of Edgar's (1987) desired curricular shift is to increase the separateness of the 
special education tracked students. Edgar agreed with Gartner (1987) that the special education 
students are already devalued and misperceived and that his recommended curricular shifl will 
not improve those perceptions, but quite likely increase the misperceptions. Nonetheless, the 
alternative academic curriculum and increased academic standards, which are emphasized in 
regular education reforms, are certainly not responsive to students' adult living needs. Following 
Edgar's logic, these regular education reforms are only likely to increase the dropout rate and fail 
to improve the students' successful employment opportunities. 
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A few observations seem needed regarding Edgar's (1987) viewpoints. The factors which 
Edgar identified as making a difference for students' post-secondary success are also the same 
ones which might be hypothesized as making a difference for the majority of high school 
students, e.g., ability level, parental support, and peer associations. However, for the majority of 
students in the mainstream of education, the curriculum does appear to make a difference. The 
other factors cited by Edgar are likely important as well, but their relative contribution is 
weighted differently. Perhaps, the relative contribution or weighting of these factors is a 
distinguishing feature of successful special education and regular education programs. 

From some sources the dropout rates in special education do not appear much different 
than from general education, though Sansone (1987) labeled it the single most important fact 
about students with handicaps in secondary settings. She reported studies in which 50 percent 
of identified learning disabled and mild mentally retarded students dropped out between when 
they entered ninth grade and their cohorts graduated from high school. In the same time frame 
32 percent of a control group of nondisabled students dropped out. Edgar (1987) reported a 
dropout rate of 30 percent among the state of Washington's students with handicaps. The U.S. 
Department of Education's Tenth Annual Report to Congress estimated that a national 26 
percent dropout rate was a conservative estimate. The generally perceived range for the dropout 
rate is between 14 and 25 percent (National Governors* Association, 1987). In terms of total 
numbers, the dropout in general education is significantly higher. Here again, additional 
information such as how these numbers and percentages are distributed by such factors as 
disability, age, sex, socio-economic status groupings, and the interaction of these factors is 
important for consideration in designing both remediation and prevention programs (Grant & 
Sleeter, 1986). Reeves (1988) reported that dropout rates in the nations* large urban school 
districts with disproportionate over-representation of poor and minority students can soar to 50 
percent or more. 

While the dropout rates may not indicate differential impacts between special and general 
education students, the percentage of special education students earning minimal wages is high 
relative to their peer group. That is, special education students tend to find themselves 
disp'-oportionately over-represented in the minimum wage level (and below) grouping. In 
contrast, their nonhandicapped peers are more evenly distributed along the continuum of wages. 
Recent discussions regarding an increa::^ in the minimum wage would have a significant impact 
on the special education population. As Edgar (1987) su^ests, special education can hardly be 
considered successful given the income levels of its former participants. Albeit income level may 
not be the sine qua non of success, it will impact the likelihood of living independently, which is 
perhaps a broader index of success. 

Other reviewers of high school special education programs besides Edgar (1987) have also 
generally supported the urgent need for refocusing the curricula. Benz and Halpem (Benz & 
Halpem, 1987; Halpem, 1979; Halpem & Benz, 1987), Clark (1974; 1979; 1980a; 1980b), and 
Brolin and Kokaska (Brolin & Thomas, 1971; Brolin & Kokaska, 1979; Kokaska & Brolin, 1983) 
have had a consistent theme regarding the balance of curricular content. They believe that the 
emphasis must shift to curricular domains in vocational, independent living, and personal-social 
content. The content of coursework is not the sole requisite to a successful transition program, 
but appropriate coursework is necessary. The authors clearly do not support a remedial 
approach to academic deficits for many students with mild educational handicaps and for most 
with moderate educational handicaps. 

Similarly, Hardman and McDonnell (1987) stressed a reexamination of the curriculum in 
light of identified special education goals following Will's (1984) statements that high school 
programs should be directed at preparing students to live and work in the community. They 
emphasized the need for schools to take the lead in ensuring that the transition planning occurs. 
Johnson, Bruininks, and Thurlow (1987) elaborated on the management strategies, training, and 
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coordination considered necessary. In curricular areas, the authors suggested that students with 
severe learning needs be provided training experiences in a variety of vocational areas, 
supported work formats, personal management, and recreational/leisure environments. 

Mithaug, Martin, and Agran (1987) shifted the focus of specific content domains to an 
examination of desired skills. Four skills were identified as crucial: (a) ability to acquire new 
skills, (b) ability to adapt to new situations, (c) ability to solve problems in different settings and 
(d) ability to maintain acceptable levels of work performance. They concluded that the 
traditional direct instructional model (Engelmann & Gamine, 1982; Gersten, Gamine, & 
Woodward, 1987) is not compatible with reaching those goals largely because responsibilities of 
choosing and evaluating one's efforts are assumed by the teacher. In contrast to the direct 
instruction model, Mithaug et al. proposed "adaptability instruction," which emphasizes the 
student's active involvement in instmction. They described four components of the model, which 
they judged were appropriate for students with mild to severe learning needs: (a) decision 
making, (b) independent performance, (c) self-evaluation, and (d) adjustment. Since these four 
components are viewed as an approach for any task, they are also appropriate to any content 
domain. The distinction they make between their adaptability model and a learning strategies 
curriculum (Deshler & Schumaker, 1986) is that their emphasis is on the critical concepts needed 
to improve post secondary adjustment and performance. Apparently, they perceive Deshler et 
al.'s work as having an in-school focus exclusively, which is not entirely accurate (see for example 
Deshler & Schumaker, 1986). 

If the question is raised, what constitutes the attributes of a good transition model, 
Stodden and Boone's (1987) research methodology identified a set of attributes for an interagency 
cooperative approach. Nine variables were identified as influencing the degree of success for a 
student's transition: a) occupational placement and maintenance, b) income level, c) continued 
education, d) community leisure activity participation, e) transportation options, f) residential 
arrangements, g) advocacy arrangements, h) medical/ health needs and their provisions, and 
i) level of personal and social adjustment. In many respects, these nine variables fit with the 
curricular domains cited by Benz and Halpem (19b7) and Mithaug et al. (1987). Gommitment 
and mechanisms for incorporating the factors into secondary level programs suitable for all 
special education students are critical to successful implementation. 

Student perspectives of the importance and utilities of their curricula provide an 
interesting comparison to the professionals' perspective. Brown, Weed, and Evans (1987) 
reasoned that such information was important to individualizing educational programs and for 
students' evaluating their educational progran: . In general, the students with disabilities 
attached greater importance to those skills which were immediately useful, to specific skills in 
vocational and domestic domains, and to more specific courses of study than the more general 
courses. The skills which students used the most frequently were not necessarily the same ones 
that they considered most important. For example, "health care" was identified as an important 
topical area, but also that it was not one which was used frequently. Work study handicapped 
students in the public school included "cooking" and "driving" as important, but also that they 
did not use those skills fr^Kjuently. From one perspective, the value of this study is that it 
illustrates the reference point of students, which might be quite narrow, and that expanding that 
perspective merits consideration as an important curricular objective for students. Poplin 
(1988a; 1988b) emphasized that assessing the students' perspectives of what is important and 
including such information are needed as curricular issues are examined. 

Conclusions. The conclusion from this review of transition-related reforms is that a 
consensus exists for the need for curricular reforms in content areas, for how students are 
engaged in instructional tasks, and for how the hi^ school's role of instruction is changed to 
include a role of initiator and coordinator of interagency cooperation and communication. These 
changes are not likely to be implemented easily. The resistance to such changes is likely multi- 
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faceted (Hagerty & Abramson, 1987; Johnson et al., 1987). However, the recommended 
directions seem compatible and supported by previously presented future scenarios of society 
(Hodgkinson, 1985) in addition to other research reviewed here. 

The linkage between the topic of improved transition services and this research project 
hopefully is obvious. Transition services focus on those activities which wdll ensure that students 
are successful once they complete their secondary level education. This project was concerned 
with identifying the parameters on which a successful special education program might be 
identified: What aie the attributes forjudging the quality of a special education program and 
what are the acti\'ities that maximize achieving those goals? The data from this project should 
provide a point of comparison or evaluation of how well the concepts of transition, vocational 
curriculum, independent living, interagency cooperation, and so on are incorporated in current 
beliefs of special education's quality. 

Regular education is the dominant force for affecting student outcomes. Accordingly, 
regular education must be considered as the major influence to which special education must 
respond or fit. Trends in regular education thus have their impact also on special education. In 
the following section, some of the reform topics in regular education are presented. The reader is 
encouraged to reflect on the impact of these reforms on special education, the regular education 
initiative, and transition services. 

Reforms in Regular Education 

As one examines the language of reform and reformers* expressed goals, a number of 
generalizations seem warranted. Among those generalizations is that the goals of the reforms 
focus on three broad domains: increased economic benefits to the United States, academic 
learning, and increased participation in the democracy (Staff, 1988). The second goal, which 
focuses on the integration of technology in daily activities, could likely be subsumed under the 
first benefit, since ultimately its consequences will be increased economic productivity and 
competition in the world*s markets. Clearly though, the emphasis or value from reforms is cast 
as economic benefits. The next several paragraphs include more specific information about the 
reform literature and alternative views for reform. The value of this information is in providing 
a contrast or development to common themes previously presented and to the themes associated 
with reforms in teacher education. 

Quite appropriately one of the values derived from the reports on reform and of the Reagan 
administration was the energy directed at answering basic questions such as: What are the roles 
of education? What characterizes a well educated adolescent at age 18? What is fair educational 
opportunity? How does one value equality, equity, and excellence? Who is the education system 
to benefit? How does society view itse'u, its future, and the role of education? As preparatory to 
reviewing the reports on reform, two topics are presented. First, a political context is presented 
from work by Glass (1987) and Clark and Astuto (1986) which helps frame the reports in the 
light of recent federal policy. Second, Walberg*s (1984) findings are summarized. From one 
perspective, Walberg's work, recent shifts in federal policy, and the reform reports are very 
complementary and several parallels are evident. However, the important contrast is between 
the mechanisms which Walberg advocates to improve edrcational outcomes and those 
mechanisms advocated in the reports on educational refoi ms. 

Reform movements within education might be thought of as furthering a political agenda 
(Glass, 1987). This thesis was central to Glass's critique of the U.S. Department of Education's 
(1986) document - What Works: Research About Teaching and Learning. In this instance, and in 
previous presidential administrations. Glass suggested that research results were cast to reflect 
political positions. ' hus, context and paradigm are important for understanding research and 
recommended refor ns. Clark and Astuto (1986) reviewed changes in the federal level's 
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education policy in the context of the Reagan first term and summarized those policies as 
representing the five D's: (1) diminution, (2) deregulation, (3) disestablishment, 
(4) decentralization, and (5) deemphasis. Substantively, these terms were implemented as 
perspectives on causes and cures for schools' problems, A partial listing of these pert^pectives 
includes: "Core problems in schools are discipline, drugs, standards, and teachers; Problems of 
education cannot be solved at the federal level; Localities should be in control of their own 
schools; Moral values, prayer, and character education need to be returned to the schools; A 
cabinet-level department of education is not needed; Teachers would be better if they earned 
salary increases by merit; Students would be better if they competed directly for awards and 
promotion; Most students do not work hard enough in school; and School curricula should 
concentrate on the basics and include more 'hard' subjects and fewer electives" (p.7). These 
perspectives are important in that they show a selective relationship between research, policy, 
and practice, which is also the point of Glass's (1987) critique, 

Walberg (1984) examined what works in education based on educational research from the 
perspective of a production model. That is, education was conceptualized using the paradigm of 
an industry with a production process. In this paradigm particular components of the industry 
were analyzed for their efficiency and effectiveness on the product. Walberg considered students' 
affective, behavioral, and cognitive learning as the products of education. Three groups of factors 
were identified and evaluated for their relative influence on learning. These three groups were: 
instruction, student aptitudes, and environmental. Within each of the three groups, a 
number of factors were identified. For example, the two factors the instruction group 
included (a) the amount of time students engage in learning and (b) the quality of the 
instructional experience, including psychological and curricular aspects. While other factors 
might also be considered important, the empirical evidence from numerous studies clearly 
favored these two factors. The factors in student aptitudes were (a) ability or prior 
achievement, (b) development, and (c) motivation or self-concept. The environmental grouping 
included four factors: (a) the home support, (b) the classroom social group, (c) the peer group 
outside the school, and (d) the use of out-of-school time, i.e., the amount of leisure-time television 
viewing, 

Walberg's production model is encouraging and provides an alternative to the reform 
literature that is currently guiding curricular and matriculation changes. We believe that such 
factors as outlined by Walberg should be considered as a better basis for reforms in the schools. 
Rather than changing reqtiirements, e,g., increasing the number of courses reqxiired for 
graduation, or blaming groups, e,g,, students and teachers do not work hard enough, Walberg's 
model emphasizes improving the quality of students' outcomes based on factors which provide 
accountability standards. This perspective has obvious advantages over a plan which only 
exposes the student to more content, e.g., adding courses to graduation requirements, or has 
more severe consequences, e.g,, requiring a test as a basis of graduation without a realistic 
provision for remediation. Several of the reports on reform are reviewed n^xt to provide a 
comparison and contrast to the preceding statements about a political agenda and Walberg's 
approach, 

A Nation At Risk: Ih^ Imperative foz Educational Reform (National Commission on 
Excellence in Education, 1983) was one of the initial papers which brought a careful focus to 
issues, problems, and recommendations for improving the public schools. Its blunt and sober 
warning that "the educational foundations of our society are presently being eroded by a rising 
tide of mediocrity that threatens our very future as a nation and a people" (p, 5) struck a 
responsive cliord in both the general public and the leadership in education. A number of 
supportive reports and books (Adler, 1982; Boyer, 1983; Goodlad, 1984; Sizer, 1984) added 
momentum to the educational reforms that are evidenced now in increased credit hour 
requirements, increased emphasis on English, math, science, and foreign language, minimum 
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competency tests, and some states moving to differentiated graduation or exit documents 
(Bodner, Clark, & Mellard, 1987; Sansone, 1987). 

While the various reports differ in style, tone, and even specific recommendations, a 
continuing theme is on achievement of excellence through increasing the rigor and amoant of 
academic courses in high school programs. Only the Paideia proposal went so far as to 
recommend a one-track high school system. The current high school track might be 
characterized as general, non-specialized and non-vocational liberal arts. The academic 
emphasis was prominent in each document calling for reform. Career exploration and 
preparation for work was mentioned in only one of the reports cited in this review (Cf Boyer, 
1983) and was the only one among the first 11 major reports that did. The term "career 
education" was not used in any of the reports, although some occupational awareness concepts 
and activities were included in a few. 

Interestingly, all of the proposals mentioned seek to narrow the offerings at the high school 
level. The proposals ignore any reference to the transition from school to the working world. The 
implicit assumption is that every high school graduate can or will move directly to college or 
further education. According to the school reform proposals, the post-secondary level provides 
the preparation for the world of work. The proposals' authors assume, evidently, that those who 
plan to enter the workforce immediately have all the skill and knowledge needed without any 
further training. This assumption is in contrast to Reeves' (1988) observations concerning 
businesses' and industries' perceived need for increased entry requirements and training. 

The recommendations of the excellence in education movement call for educational 
practices that were the subject of the criticisms of education in the 1960s e.g., school alienation, 
drop outs, and low achievements of graduates. They are the chief reasons why the National 
Advisory Council on Vocational Education formed the concept of career education that was so 
ably articulated by Marland (1971). Most important, we concur with Phelps (1985), Toch (1984), 
and Yudof (1984) that these recommended reforms offer no alternatives to people who cannot 
perform well in an academic arena. If one fails to respond to the academic challenges, no 
compensatory avenues are open to that person. In a country that considers diversity one of its 
major strengths, the excellence in education proposals emerge as anachronisms that ignore the 
needs of non-college bound youth. 

The possibility exists that special education is the standard for other segments of public 
education. The separateness of special education and the popular perceptions of its value - 
providing a range of quality educational and related services - to students whose special needs 
are not addressed within the regular curriculum may be its greatest asset. What is it that 
regular educators are advocating in reforms? The list of reforms seem to include: greater 
specificity in the curriculum, better response to individual learner needs, appropriate learning 
opportunities, better defined outcome goals, minimal academic standards, increased number of 
credits for graduation, and better preparation for students in a low achieving curriculum. If each 
of these reforms were considered separately, doesn't special education have an understanding of 
each of them? These reforms have been considered, quality measures have been used, and policy 
discussions have occurred within special education. This history would likely prove valuable to 
general education. 

Special education perhaps should do a better job in each area because of the differential 
dollars provided. On the other hand, the needs of the students receiving the services are more 
severe in special education than in regular education. These students' characteristics work 
against achieving these goals. Another isoue is that special education only includes 10% to 12% 
of the student population, and thus is dealing with a smaller segment of the population. 
Nonetheless, those students in special education are not the "best" learners or most motivated. 
On almost any dimension of student characteristics, the student group is skewed on 
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characteristics working against learning and achievement. In contrast, the regular education 
enrollment is more normally distributed and, if it is skewed, the skew likely runs the opposite 
direction of the special education distribution. Again, that distribution of students' knowledge, 
skills, and abilities should likely benefit outcome indices in regular education. The issues 
presented in these last few paragraphs are intended to suggest alternatives for consideration as 
local districts consider reforms. The intent was not to rank order the qualities of special and 
regular education segments in the public schools. 

Sansone (1987) suggested that a logical relationship might exist between the secondary 
school reform movement and the dropout rate of both handicapped and non-handicapped 
students. That is, the increasing dropout rates can be explained by the increased academic 
demands in number of credits required and increased emphasis on more academic content in the 
required units for graduation. The question could be raised, however, "Is the special education 
programming adequate?" If the programming is not adequate, is the training or preparation of 
the teachers resulting in discouraging outcome data for both graduates and dropouts? 

SerondflTv Level Pre-service Teacher Training 

School reforms are not independent of the teacher training institutions which provide the 
schools' staffs. As such, recent evaluations and reforms directed at teacher training for general 
and special education are worthy of consideration. To highlight perspectives of both general and 
special education training programs each will b(; treated separately. In neither case, however, 
are the presentations extensive. A few significant elements are sufficient to characterize the 
teacher training issues within this report's context. 

General education nre^service training . Clark (1988), Combleth (1986), and Futrell (1986) 
have suggested a parallel between reforms in regular education and those advocated in teacher 
training. The parallel is that in both arenas a technical "fix" and increased standards are 
proposed. Warren (1985) has carefully documented the historical development of the teaching 
profession and reported examples of these two dominant trends in classroom and teacher 
training reforms: 

First, from the early nineteenth century forward, market considerations have driven 
both the policies and the curricula in teacher education, as both have responded to 
shortages and surpluses of teachers. . , The teacher economy continues to function 
independently of professional judgment about teacher education, as ii did in the nineteenth 
century, and independently of research findings, as it does in our time. 

Second, attempts to clarify responsibility for teacher education reflect a long historj' of 
controversy over the separateness of teacher preparation programs, . . Teacher education, 
like other higher education programs, has felt the effects of academic politics, that is, the 
faculty's competition for enrollments, budgets, and prestige. 

Third, from the outset, teacher education has been viewed as virtually synonymous 
with instructional preparation. . . To the extent that the emphasis on methodological 
practice has prevailed, teacher education ironically has grown increasingly remote from the 
conditions of teaching and the experience of teachers, neither of which have been 
confinable to classrooms. Offered in isolation, preparation for instruction has left teachers 
unprepared for their more difficult responsibilities, which are to conceptualize, innovate, 
and analyze disparate educational and policy phenomena, (p. 10-11) 

Combleth (1986) and Futrell (1986) elaborated on Warren's (1985) observations, and 
argued that reforms generally are "band-aids" which ignore broader issues in education. 
Combleth and Futrell emphasized the need for basic questions of values, substance, and goals 
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being specifically answered prior to consideration of appropriate reforms. They believe that 
substantive discussions would suggest that the structure of schools is in need of restructuring. 
In these restructured schools, organizational and purpose issues would be addressed. Their 
recommendations would emphasize that teachers have greater responsibility for what happens 
in the schools and ths>t reforms be generated from a bottom-up orientation. Classroom 
experiences would be emphasized in the restructxiring. In contrast with their recommendations, 
Futrell observed that a "fiill 90 percent of the legislative acts that have been termed educational 
reforms have, in fact, been regulations - regulations that severely restrict teachers' rights to use 
their own judgment, regulations that usurp the authority that appropriately belongs to teachers, 
parents, and local communities, and regulations that dwell on the quantitative, on what is 
countable, easily measured, and reducible to checklists." (p. 6) Such reforms only tangentially 
consider substantive issues. 

The link between these views and recent research in teacher education can be made by 
examining work which concerns the teacher as a decision-maker. C. Clark (1988) and Shulman 
(1988) reviewed teacher training programs and raised the questions of teacher training exercises 
which assist a teacher in confronting the classroom setting. This setting was characterized by C. 
Clark as presenting a myriad of decisions, uncertainty, and dilemmas. In this setting the 
teacher relies on content knowledge and pedagogy, which have rarely been balanced in training 
programs. As Warren suggested, content knowledge has generally been emphasized over 
instructional methods, i.e., information was taught but not how to teach in the complexity of the 
classroom setting. Shulman (1986) offered a paradigm in which types of teaching knowledge, 
which includes but is not limited to content and process, can be studied and integrated. This 
integration would alter training programs by developing a stronger association with classroom 
practices and certification requirements by emphasizing the multiple domains of knowledge 
required in the teaching profession. 

In summary, this section present'^id a critical examination of teaching, education reforms, 
and teacher education reforms. To alter education, the reforms need to consider the training 
programs, the providers of the instruction, and school structure. Reform directed from top-down 
processes are more likely quick fixes, with httle impact, and maintain existing educational 
structures. Combleth (1986) and Futrell (1986) provide a frairework for understanding the 
existing ritual of reform and alternative methods. Research on teaching and teacher training 
emphasizes that education is better conceptualized as a process directed by a classroom teacher, 
who is confronted with complexity, decisions, and dilemmas in the classroom. C. Clark (1988) 
and Shulman (1986) have indicated some of the complexities in these processes, and also have 
offered a paradigm from which aforementioned reforms could be developed. Altering educational 
outcomes would have greater likelihood by addressing the areas of school structure and teacher 
education. 

Special education pre-service training . Since the mid-50s, the uniqueness of exceptional 
students has promulgated an assumption that separate, additional training is required for 
teachers teaching such students (Clark, 1984). In fact, as in many comparable situations, the 
homogeneity among the programs was greater in those early days than at any time since. Over 
time, training programs have emphasized various types of curricular content, assessmen , 
management, and pedagogical knowledge tailored to particular categorical groupings, e.g., 
teachers of students with deafness, visual impairments, mental retardation, emotional problems, 
learning disabilities, and language delays. The resulting heterogeneity is not unlike pre-service 
teacher programs in regular education. 

A number of causative factors have been implicated as agents for this diversity. These 
causative factors have been very specific to the training programs in some instances and in 
others quite general and external. In addition, these factors are not particularly unique to 
special education pre-service training programs, but influence pre-service training for non- 
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special education teachers as well. Factors adding to the training programs' diversity are the 
goals, philosophy, and other qualities of the teacher training programs themselves. Some of 
those qualities which influence training programs were identified as location, size, faculty 
interests, and student characteristics. Mclaughlin, Valdivieso, Spence, and Fuller (1988) have 
described changing student characteristics as an issue which training programs have not 
considered recently. The training programs have continued adherence to activities and 
competencies geared to the full-time graduate student and not the part-time student with 
professional status and full-time employment who is interested in acquiring additional credits for 
advancement on the local school district's salary schedule, or a new credential or teaching area 
endorsement. 

A second factor influencing training programs is states* certification requirements. 
Bursuck and Epstein (1986) reported that colleges and imiversities respond to standards set by 
state agencies. This view is supported also in the McLaughlin et al. (1988) report. McLaughlin et 
al. suggested that "special education teacher training is being driven by forces such as 
certification policies that are largely out of the control of the profession and needs of local school 
districts" (p. 215). Higher education faculty feel powerless to influence any decisions regarding 
certification standards and criteria. A third factor, which is also closely tied to state department 
of education issues is the service delivery models for which local districts receive reimbursement. 
The procedural requirements in federal level legislation (e.g., PL 94-142 and PL 99-457) have 
dictated procedures and types of services, both in instructional and related services, which 
districts provide as part of special education. These legal restrictions influence the higher 
education faculty's choices for content and training activities. A fourth factor, the proliferation of 
categorical programs, is also affiliated with legislative and regulatory activities at federal and 
state levels. The proliferation is noted in types of programs, settings in which services are 
delivered, and the age ranges of the students or clients served. A fifth factor is the lack of a 
centralized authority for long-range planning and control. Planning and control issues are 
argued among all of the principals involved. Though too, to conclude that centralizing the 
process is a good idea is much easier to arrive at than an agreement on how such a process would 
be implemented. Control is such a fundamental issue that political considerations would be 
major. 

Other factors have also been identified. The initiatives to deinstitutionalize individuals 
with various disabilities, to increase community-based training programs, and to mainstream 
students in regular class settings have each separately impacted teacher training programs. 
Research has also influenced teacher training. Sansone (1987) summarized findings in four 
research areas which have had such impact: (a) development of learning strategies curricula for 
secondary level students, (b) usage of computer applications, (c) new programs for students with 
moderate and severe handicaps developed as a result of deinstitutionalization, and (d) a 
broadening of vocational educational assessment and training approaches. The shift in training 
emphasis as a result of these factors has not been trivial. In each instance, the perceived role of 
the teacher was altered, generally by the addition of responsibilities and increased competencies 
in more content and skill domains. As a consequence, added competencies and knowledge are 
needed by secondary level special education teachers. 

In light of these factors impacting programs, a number of studies have recently reviewed 
current status and trends in both SEAs' certification requirements and higher education's 
training programs for special education teachers. Results of four such studies were chosen for 
inclusion here both because of their recency and diversity of results. Bursuck and Epstein's 
(1986) survey of teacher training programs provides a description of current trends. Their 
particular interest was in learning the extent to which programs prepared teachers for secondary 
settings. One characteristic for making such inferences concerned differential teaching 
certificates for elementary and secondary school levels. Fourteen states were identified as 
distinguishing elementary and secondary level certificates. In each of the 14, a practicum in 
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secondary setting was reqixired, while only 34% of the other states had a comparable 
requirement. Teacher trainers were also asked to rank order nine competencies needed in 
teaching mildly handicapped adolescents. The 130 respondents provided the following ordering 
of most to least important skills: 1) design, implement, and evaluate instructional systems; 2) 
design, implement, and evaluate behavioral management strategies; 3) use norm-referenced, 
criterion-referenced, and informal measures for lEP development and implementation; 4) use 
existing resources effectively and efficiently in educational programs; 5) engage in professional 
behaviors which lead to effective communications and productive relationships; 6) establish 
positive working relationships with parents; 7) be knowledgeable of issues involved in educating 
adolescents; 8) be respected and accepted by pupils and colleagues; and 9) have literacy in 
computer skills for training students. The authors noted that these rankings were independent 
of state's certification rankings, perceived level of preparedness of program graduates, program 
size, or geographical region. While these rankings are quite robust, the authors were 
disheartened: 

It is difficult to believe that qualified (emphasis added) secondary teachers are being 
prepared when 35% of the programs do not offer specially designed courses on the 
handicapped adolescent, when 55% of the programs do not supplement their course 
offerings by required secondary-level courses in other departments, and most importantly, 
when 45% of the programs do not require a secondary school experience (p 7). 

Chapey, Pyszkowski, and Trimarco (1985) surveyed SEAs for their trends and plans in 
certification and training requirements. Their questions and results are somewhat different 
from Bursuck and Epstein's (1986) findings, who had surveyed training programs, Chapey et al. 
reported that 35 states (70%) desired a noncategorical certification model. The need for 
secondary level designation also was questioned. Thirty-eight percent would prefer to have K - 
12 teacher certification with a special education endorsement. The authors interpreted this 
finding as supporting the concept of the regular education teacher as having primary 
responsibility for all students and that the special education teacher was to serve in a supportive, 
consulting role. The desired trend in future training was for a noncategorical model (66%). The 
remaining 34% favored a categorical model. Interesting data not reported would be the 
percentages for those states for which this response was a shift from current practice. The 
authors concluded that their data were not indicative of a clear pattern in teacher certification, 
but that the future trend was for noncategorical certification and additional training in special 
education for regular education teachers. In the context of the reforms occurring within regular 
education, the authors advocated for states to give leadership and direction to the 
"standardization of special education teacher certification" through the following activities: 

1. Sponsor task forces, involving all levels, state and local, to study certification and 
training requirements. Current research findings should be integrated into such 
deliberations. 

2. Establish and disseminate more uniform standards and guidelines, from state to state, 
for special education teacher certification. 

3. Initiate closer interstate relationships to assure that special education teachers in all 
parts of the nation achieve a high level of competency. 

4. Serve as a catalyst for strengthening and fusing the intrastate connections among 
college training faculty, local educators, and state education officers. 

5. Encourage essential research in developing or identifying models of teacher 
certification and teacher training so that teacher competencies will match the 
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requirements for quality services in a wide variety of handicaps, in a broad spectrum of 
organizational settings, (p. 208) 

Bodner et ah (1987) surveyed the state directors of special education regarding program 
requirements and practices. One survey section included a rating procedure for directors to 
identify the importance and emphasis given to selected program practices. The program 
practices were selected because research suggested that those practices influenced the quality of 
special education programs. Twenty-one such influences on high school level special education 
practices were included in the survey. Teacher certification practices were referenced in three of 
the 21 items. The results were likely disheartening to teacher trainers. Among the five least 
important practices were the three teacher education influences: (a) certification according to 
instructional level, (b) instructional level certification, and (c) interdisciplinary certification. 
Apparently, teacher training is not considered as a major influence, a conclusion similarly made 
by Bursuck and Epstein (1986) and McLaughlin et al, (1988). Thirteen states (25%) reported 
that they have separate requirements for high school level special education certification 
procedures, Bursuck and Epstein reported that 14 states had separate certification 
requirements. 

McLaughlin et al, (1988) described four studies of training needs and current practices. 
The four studies relied on different methods and respondents in obtaining the data and thus 
captured multiple perspectives. The data collected through surveys and interviews with SEA 
representatives and higher education teacher trainers were the focus of this review, A major 
finding which emerged concerned differing perceptions among SEA personnel and teacher 
trainers. This perceptual difference concerned competency in recent graduates. SEA personnel 
reported that new teachers lacked competencies in administrative areas such as "developing 
Individualized Educational Plans, participating in multidisciplinary team meetings, and 
'understanding due process' " (p, 216), Two other frequently mentioned areas concerned 
teachers' collaborative skills with regular educators and the quality of generic or cross- 
categorical teachers. As one explanation for these criticisms, teacher trainers commented that 
their training priorities were in areas related to "assessment skills and developing 'lesson plans' 
and instructional programs," Consultation skills was rated 12th out of 13 training priorities 
emphasized in the programs. These data are indicative of perceived diverging values among 
SEAs and teacher trainers. Resolution of such differences is important and yet not a simple 
task, 

McLaughlin et al,'s (1988) findings pose a variety of issues for training programs and 
SEAs, Both bureaucracies have established traditions and yet are vying for control of a 
profession and an institution with seemingly different values and policy directions. The authors 
suggest that "national quality indicators for special education personnel need to be developed 
and accepted" as a precursor for changes in the training programs. Quite forcefully they 
advocated that "working relationships, not paper committees and formalized rubber stamping, 
are required between consumers and producers to identify training needs and develop training 
programs that will maintain a supply of teachers for the handicapped and at the same time 
preserve the quality of their personnel" (p. 220). 

Interestingly, Sutherland and Castleberry (1985) reviewed minimal standards for teacher- 
training programs and cited a number of other previous efforts with similar intentions: Clair, 
Hagerty, & Merchant (1979); Gosman (1985); Morey (1983); and Reynolds, Birch, Grohs, 
Howsam, Corrigan, Denemark & Nash (1976). Sutherland and Castleberry described their 
research and development of a self-evaluation instrument applicable to higher education's 
training programs. However, the issue remains that such research efforts lack the kind of 
validation needed and only possible when an agreed upon set of standards have been identified 
as the modal direction. 
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The four survey research reports (Bodner et ah, 1987; Bursuck & Epstein, 1986; Chapey et 
ah, 1985; McLaughhn et ah, 1988) represent a defined orientation, though not necessarily 
compatible views, regarding the needs in teacher training and certification reform. Other 
authors have advocated for specific changes in these two areas as well. Pugach (1987) and the 
Holmes group (1988) advocated for restructuring based on tenets of the regular education 
initiative, which was outlined earlier in this report Their efforts deemphasized a distinction 
between the training needs of special and regular educators. Pugach argued that the duality in 
views actually relieves regular educators from improving their instructional methods to 
accommodate the diversity of classroom students: "A fundamental question for educators who 
prepare teachers of mildly handicapped students is the extent to which they wish to justify their 
field's continued existence on the basis of problems in the content of the general teacher 
education curriculum" (p. 311). 

Pugach (1987) cited the specialization in the schools as another problem. The claim of 
"distinctive disciplinary content" of specialists perpetuates an unfortunate hierarchy within the 
school systems, which is itself perpetuated by the separateness of training and certification 
requirements. Cobb, Hasazi, Collins, and Salembier (1988) presented a counter viewpoint. They 
advocated for yet another specialist position in the secondary schools, that of a school-based 
employment specialist. They validated this need based on results from studies of the low rate of 
successful transition which students encounter in their transition from high school programs to 
independent living and vocational responsibilities as adults. They also cited recent studies 
reporting the high dropout rates and low employment rates of special education students (Hasazi 
et al., 1985; Mithaug et ah, 1985). Clark (1984) reviewed developments in secondary special 
education and addressed concerns about specialization. Like Cobb et al. (1988), he also argued 
that the distinctive roles of secondary special education personnel were real and needed to be 
reflected in certification and training requirements. He argued for interdisciplinary training and 
greater efforts by professional organizations e.g., the Council for Exceptional Children, to 
establish training standards. 

Weisenstein's (1986) views were similar to Cobb et al. (1988) and Clark (1984) in that he 
emphasized the distinction between secondary and elementary special educators' roles. The 
issues posed by ensuring successful transition require additional specialization at the secondary 
level and recognition of these differences in states' certification requirements and training 
institutions' course and field work degree requirements. "A technology is being built around 
secondary special education that can only be taught through a combination of specialized course 
work and field experiences" (p. 5). Weisenstein's recommendations included eight areas of 
required coursework: 

1. Understanding of, and ability to utilize, assessment in the areas of vocational, 
academic, and functional skills. 

2 Teaching techniques and instructional materials related to each of Brolin's (1978) 
curriculum areas (personal-social skills, daily living skills, and occupational guidance 
and preparation skills), as well as academic areas. 

3. Work adjustment strategies for developing effective work personalities and 
remediating work habit and attitude deficiencies. 

4. Classroom management techniques appropriate for adolescent and adult students. 

5. Identification and use of instructional resources, human service agencies, and 
community enterprises. 
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6. Techniques of interdisciplinary coordination, including a basic understanding of 
related, or allied, disciplines. 

7. Counseling and guidance techniques which can assist the teacher in serving both 
parents and students. 

8. Program planning and evaluation skills. 

This discussion of special education teacher training has highlighted a diversity of 
perspectives which are represented by a voluminous literature. This material serves as a 
background against which the survey data obtained in this study can be compared. Our intent 
was to provide a comprehensive treatment of the range of perspectives and not a comprehensive 
review of the total literature. Our conclusion from these disparate viewpoints is that special 
education training and certification issues are not unique from similar issues in regular 
education. The lack of central planning and authority is cited as critical in both segments. The 
impact of the regular education and transition initiatives is also evident. As one evaluates the 
outcomes of special education, a case can be made for also reviewing the pre-service training and 
SEAs' certification requirements as causal agents in those outcomes. In that line of logic, the 
competencies and role distinctions among educators require careful consideration. 

Conclusion 

This introductory section provides a review of the research literature considered relevant to 
this project. We believe that one s appreciation of the complexities of special education programs 
increases from an understanding of other contextual events, initiatives, and situations. To 
understand secondary level special education, we have reviewed a number of factors believed 
relevant: changing demographic characteristics of society and thus the students, reform efforts 
within regular and special education programming, and reforms in the training programs for 
both regular and special education teachers. The impetus of these reforms reflects a 
conservative philosophy and desire to increase America s viability in the world markets. In 
regular education programs the recent reforms have emphasized increased excellence by 
promoting the importance of basic academic skills and increased requirements. In special 
education two dominant themes have been on (a) improving the successful transition of students 
from high school to becoming integrated, contributing members of society and Cb) restructuring 
special education to ensure that regular educators do more to accommodate slow learning and 
low achieving students in the classroom. In teacher education programs for both special and 
regular educators, advocates of multiple, diverging viewpoints have been reported as well as 
proffered reforms. Our efforts were to provide a frame of reference for understanding the teacher 
education reforms as they affect both certification requirements and higher education. We 
believe that these perspectives are crucial to understanding this project. In the following 
sections, survey results are presented which reflect the perspectives of higher education teacher 
trainers, superintendents of schools, and directors of special education on the desired qualities of 
secondary level special education programs and teaching staffs, and those activities which lend 
themselves to developing those qualities. 

Results of five surveys are reported in the following sections. Each section is devoted to an 
individual survey. In presenting the results a brief introduction is included to frame the issues 
and questions addressed by the particular survey. In addition to the findings, the procedural 
issues and limitations are reported. Last, the findings are described in the context of the initially 
presented research issues and questions. 
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Survey 1: Elicitation Survey to Directors of Special Education^ 
School Superintendents, and Teacher Trainers 



Overview 

High school special education programs and pre-service teacher training programs are 
found across the country. These same education programs are shaped by a number of 
divergent elements and competing priorities (Bodner et aL, 1987). Many of those elements 
were reviewed in the preceding introductory section, Society*s demographic characteristics, 
reforms in regular education, the transition and regular education initiatives, and reforms in 
pre-service training for general and special education teachers were identified in that section. 
Our review contrasted the divergent views on such issues as: What challenges are presented 
by the changing demographics in American society for the social, economic, and educational 
institutions? What are the desired outcomes of general and special education programs? 
What should be the relationship between general education and special education in serving 
students? In general and special education what are the values for improving the transition of 
students from the educational setting to the work and community setting as independent 
functioning adults? What reforms are needed to ensure that teachers are adequately prepared 
for their multiple educational responsibilities? 

Fundamentally, these questions concern the desired qualities or attributes of educational 
programs. Answers to these questions and descriptions of the influencing elements were 
described from material in the research literature. The materials were included to represent 
current issues and recommendations as described by a group of professionals. The coverage 
was not intended to be comprehensive, but rather serve as representative perspectives for 
improving the quality of educatio:n. Other perspectives are also worthy of consideration in 
(a) describing current perceptions of high school special education programs for students with 
mild to moderate handicaps, (b) offering recommendations for future directions in developing 
such programs; (c) describing the desired qualities characterizing the teaching staff of special 
education programs for students with mild and moderate handicaps; and (d) offering 
recommendations for pre-service teacher training programs. Three such groups' perspectives 
were chosen for this project's research efforts: directors of special education, superintendents 
of schools, and pre-service teacher trainers. This latter group encompasses those college 
faculty members who are engaged in teacher training for secondary level special education 
programs. 

Methodnlogical Cn nsideratinnR 

This section includes a review of major decision points in the course of the project. As 
such a number of the alternative considerations are identified, A reader's review of this 
section will provide the rationale for those decisions which were considered as having a major 
influence for the project and thus provide a context within which the results should be viewed. 
The topics considered as having this major influence include: (a) the goals and format of this 
survey, (b) the choice of the sampling plan, and (c) the selection of the response groups. 

Survey considerations . The elicitation survey, which is described in this section, was 
the first step in capturing current perceptions. The elicitation survey was designed to gather 
information on two dimensions of programs and staff. For the first dimension, our purpose 
was to elicit from the participants their considered judgments regarding the qualities or 
attributes which one should consider in evaluating a high school special education program or 
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its teaching staff. Prom another perspective, these attributes might be thought of as the domains 
of interest, those programmatic features which might distinguish among the many available 
programs. The attributes might be considered a basis for evaluating programs or staff by 
serving as standards. The second dimension had a very different focus. For the survey's 
second dimension, the respondents identified those activities which characterized the high 
school program and the pre-service training. These activities can be understood as the tasks 
or the means one might use to develop or to realize a particular attribute. For example, once a 
goal is specified, one's next decision is to specify the alternative means to reaching that goal. 
Eventually, the alternatives are considered, weighed, and some plan is devised. The goal of 
the second dimension of the survey was to identify those alternative options one might 
consider. 

The unconstrained, open-ended survey constniction was considered as appropriate to 
this task. The format permitted the widest range of possible answers and removed the time 
constraints which often accompany alternative data gathering methods, e.g., structured 
interviews. In addition, the format permitted the widest range of distribution because of its 
comparatively low costs, and the expected raw data, i.e., verbal descriptors, could be analyzed 
using a number of methods. 

Sampling plan. The national perspective on special education programs and staffs was 
judged important and thus the decision was made to sample from individuals across many 
states. While individual states confront the peculiarities which differentiate one state from 
another (e.g., geography, population density, climate, financial resources, racial and ethnic 
mix, and administrative organization) the differences were judged more likely to reflect 
differences of degree rather than quality. For example, financial support influences 
programs and staff but for some states this element has greater importance than elsewhere. 
Since many of the reforms are directed from the federal level, the national focus would also be 
important to understand. The value of just completing an in-depth study of a few carefully 
chosen states was very strong, but was resolved by concluding that the more narrow focus 
would be appropriate as a subsequent proposal. The more global representation provided 
gi eater generalization and comprehensive snapshots of current priorities across the country, 
which in turn might have gi'eater influence on federal initiatives in education. 

Response eroiap^^. The research literature represents the views of a select group of 
education professionals. Those views were presented in the initial overview of the report. The 
project staff assumed that other perspectives were also worthy of consideration, e.g., students 
in special education programs, parents of those students, their teachers, and their 
administrators. The three groups chosen in the project (directors of special education, 
superintendents of schools, and pre-service teacher trainers) also represented unique views 
regarding the desired attributes of special education programs for students with mild or 
moderate handicaps and their teaching staff. Names of these individuals were obtained 
through reliable methods and thus resulted in a minimal effort to identify respondent 
samples. In contrast, the use of parents or students would have raised questions about 
confidentiality, representativeness of the samples, and ease of access. Teachers would have 
also been desirable respondents on the issues in question. However, additional selection 
issues would have been raised. A district level staff member would likely be needed to supply 
teacher names and addresses or route the surveys to them, which also would have raised 
representativeness questions. While teachers are the actual implementers of policies, the 
survey staff felt that the administrative groups chosen were more important to represent in this 
study since they are responsible for the policy development and evaluation itself In addition 
some thought was also given to the fact that the three chosen groups were actually a smaller 
better defined population, and thus they could be more reliably sampled. They also could be 
considered as a probability sample, since the likelihood of being selected to participate could be 
defined. This point also has value in understanding the limits of generalizing the findings. 
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Sampling at the student, teacher, parent, and building administrator levels was judged 
especially important if one was to focus on an individual state. As indicated previously, 
project staff considered a national perspective more important to represent. 

This concludes the overview material for the elicitation survey. In the following text, 
details of the methods, results, and conclusions are provided. 



Subjects 

Three groups were sampled in this survey: (1) directors of special education (DOSE), (2) 
superintendents of schools (SOS), and (3) pre-service teacher trainers (PTT). A two stage 
sampling plan was followed in choosing the DOSE and SOS. The first stage was the selection 
of states from which to draw the samples and the second stage was the actual selection of the 
DOSE and SOS. 

Directors of Education and .9npftrinten dents of Schools . Constraints within the project 
necessitated that a limited number of DOSE and SOS be sampled. Alternatively, to preserve 
the national focus of the research project, the sample was drawn from within selected states. 
To accomplish this goal, thirteen states were randomly chosen without replacement from the 
fifty states. The resulting randomly selected states were Delaware, Idaho, Indiana, Iowa, 
Kansas, Kentucky, Missouri^ Nevada, New Hampshire, North Carolina, Oregon, 
Pennsylvania, and South Dakota, This permitted a sample representing 25% of the states and 
was deemed consistent with the project's goal of establishing a national perspective. 
Representatives in the states' department of education were contacted and requested to provide 
a current listing of DOSE and SOS. All states but one (Idaho) provided the listing. The 
representative in Idaho indicated that if the survey was forwarded to the state department, staff 
would insure that it was mailed to a random sample of DOSE and SOS. 

The names of DOSE and SOS from the twelve states' lists were entered into separate 
databases. Proportional samples were drawn randomly from these lists without replacement. 
The probability of any one name being chosen was the same for each person from a given state. 
The proportional samples were chosen to maintain a balance across the states that were 
sampled. For example, superintendents from states with large numbers of superintendents 
would have a greater likelihood of being chosen than those from states with a fewer nm ^er. 

To maintain the proportionality of each state's sample the following procedure was 
followed. First, a sample size of 250 for both DOSE and SOS was chosen by project staff as being 
an adequate size and in line with the budget and management constraints. Second, separate 
totals were determined for the population of DOSE (N = 872) and SOS (N = 1714) in the 13 
previously selected states. Third, the proportion of each state s contribution to the total was 
calculated. For example, Delaware's proportional contribution to the total number of DOSE 
was 3%. That is, Delaware had 27 DOSE. Those 27 were three percent of the total number 
(N = 872) of DOSE in the thirteen states sampled. Three percent was multiplied by 250, (the 
desired sample size), which yielded 7.5. This value was rounded up to eight. Thus, eight 
DOSE were randomly chosen from the Delaware listing as potential survey respondents. The 
same sampling procedure was followed for the SOS. 
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Tables 1 and 2 include a listing of the DOSE and SOS population and sample sizes for 
each state. Note that in rounding off the values, the targeted sample size of 250 for each group 
was exceeded. The DOSE sample was 251 and the SOS sample size was 254. Surveys forms 
with accompanying cover letter and stamped return envelopes were mailed to the individual 
DOSE and SOS. For the state of Idaho, eight packets for superintendents and sixteen directors* 
packets were mailed to the state department of education for random dissemination. 

Pre-service teacher trainers. Complete listings of teacher trainers were not available as 
they were for DOSE and SOS. Thus a different plan was needed for identifying this 
population. The goal was to identify pre-service teacher trainers in special education, i.e., 
those higher education faculty members who were interested in preparing teachers for special 
education programs for high school students with mild to moderate handicaps. The emphasis 
on teacher training for secondary level was believed important because of the nature of the 
information elicited from them. The Teacher Education Division of the Council for 
Exceptional Children recommended a directory published by the National Information Center 
for Children and Youth with Handicaps (NICCYH, 198. ) as a resource for identifying teacher 
training institutions with special education programs. 

Seven hundred sixteen teacher training institutions with programs for mild to 
moderately handicapped students were identified from the NICCYH directory. The 
chairperson at these institutions was contacted by letter (see Appendix A) and asked to identify 
specific faculty members with interests in secondary level education. The replies resulted m 
a list of 640 names. From this list 305 names were randomly selected without replacement, 
again using a proportional sampling procedure. A minimum criterion was chosen that at' 
least one individual in each state must be included in the sample. The plan was to draw a 
national sample of 250 PTT. By rounding off the percentages and requiring that at least one 
PTT be selected from each state, the final count was 305. Unlike the DOSE and SOS samples, 
the PTT sample was not restricted to 10 states, but rather included all 50 states. 
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Table 1 

Tota. and Proportional Numbers of Directors of Special Education mOSE) for the Elicitation 
Survey 



States Directors of Special Education 





n 


% of total n 


Proportional n 


Delaware 


27 


3.1 


8 


Idaho 


55 


6.3 


16 


Indiana 


79 


9.1 


23 


Iowa 


15 


1.7 


4 


Kansas 


71 


8.1 


20 


Kentucky 


78 


8.9 


22 


Missouri 


136 


15.6 


39 


Nevada 


10 


1.1 


3 


New Hampshire 


54 


6.2 


16 


North CaroHna 


142 


16.3 


41 


Oregon 


149 


17.1 


43 


Pennsylvania 


29 


3.3 


8 


South Dakota 


27 


3.1 


8 


TOTALS 


872 


100 


251 
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Table 2 

Total and Proportional Numbftrs of SuperintftTidents of Schools fSOS) for the 
Elicitfltinn Survey 



States 


Superintendents of Schools 






ji 


% nf frjfj^l n 


Proportional n 


Delaware 


18 




3 


Idaho 


57 


3.33 


8 


Indiana 


147 


8.58 


22 


Iowa 


219 


12.78 


32 


Kansas 


152 


8.87 


23 


Kentucky 


187 


10.91 


27 


Missouri 


305 


17.80 


45 


Nevada 


17 

JL 1 


u.yy 


3 


New Hampshire 


54 


3.15 


8 


North Carolina 


75 


4.38 


11 
11 


Oregon 


138 


8.05 


20 


Pennsylvania 


253 


14.76 


39 


South Dakota 


92 


5.37 


13 


TOTALS 


1714 


100 


254 
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Materials 



This first survey for all three groups was referred to as an elicitation survey. The survey 
was very similar for the three groups. The stimulus items focused on special education 
programs and staff. The goal of the survey was for DOSE and SOS to list (a) the attributes and 
(b) the activities characteristic of quality special education programs for high school students 
with mild to moderate handicaps and also of quality teaching staff in those programs. The 
goal of the PTT survey was that the respondents list (a) the attributes and (b) the activities 
characteristic of quality special education programs for high school students with mild to 
moderate handicaps and also to consider (c) the characteristics of a quality teacher and (d) the 
pre-service activities which would teach those characteristics. 

The elicitation survey for the DOSE and SOS is provided in Appendix B. The same 
survey was mailed to both groups, although the forms were color coded. Surveys mailed to 
DOSE were printed on white bond paper, while surveys mailed to SOS were on goldenrod. Part 
I-A was designed for the respondents to list the attributes for evaluating the success of a high 
school special education program for the students with mild to moderate handicaps. Eight 
blank lines were provided for the responses. Part I-B was designed for listing the activities or 
components important to special education programs. As in Part I-A, eight blank lines were 
provided for the respondents to record their answers. Part II-A provided space for listing those 
attributes on which they would evaluate special education teaching staff for students with mild 
to moderate handicaps. Part II-B was designed to ehcit a listing of those activities on which a 
teacher might be evaluated. The last page of the survey (Part III) included questions 
concerning the respondent's level of training, district setting, and enrollment size. The goal 
of Parts I and II was for the respondents to distinguish between the attributes or qualities of a 
high school special education program (Part I-A) and the activities in the program (Part I-B). 
Conceptually, one may describe those attributes, but those attributes occur within a context of 
particular activities. Similarly, one can describe the attributes of a quality teacher (Part II-A), 
but one should also specify the activities on which a teacher should be evaluated. For example, 
a teacher attribute might be that of "good disciplinarian." Some activities are better suited for 
evaluation of that attribute than others, e.g., large group instruction vs. attendance at a 
professional meeting. 

The elicitation survey for the PTT was initially the same as the survey used for the DOSE 
and SOS. However, revisions were made to Part II-B based upon early DOSE and SOS 
responses. Parts I-A, I-B, and II-A were essentially the same as the form used with the DOSE 
and SOS. Part II-B which focused on teacher activities was changed. The focus switched to 
what pre-service activities were included or should be included to develop those specific teacher 
attributes believed important. Part III included questions about the respondent and his/her 
college or university. A copy of the survey for the PTT is in Appendix C. 

Procedures 

Pilot Study . The survey instrument was distributed to nine directors of special education 
in Kansas and Missouri on April 16, 1986. Based on their written comments and phone 
interviews, the survey to the DOSE and SOS was revised. Their comments encouraged the use 
of additional examples, shortening the instrument, and altering word choices. 

Survey procedlirfiff. Elicitation surveys to the 251 DOSE and 254 SOS were mailed May 14 
through 16, 1986. Enclosed in the materials was a letter of explanation, the survey itself, and a 
postage-paid envelope for returning the survey. Follow-up postcards were mailed on Mav 29 
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Elicitation surveys were mailed to 305 PTT on November 11, 1986. Enclosed in the 
materials was a letter of explanation, the survey itself, and a postage-paid return envelop. 
Follow-up postcards were mailed approximately one week later. The time lag between the 
mailings to the DOSE and SOS and the PTT was due to the extra efforts required in obtaining 
and preparing the mailing list for the PTT. A fortuitous event was the opportunity to receive 
the DOSE and SOS returns and alter the instructions for Part II-B due to apparent inadequate 
task instructions, 

Sur\^ev returns . Table 3 provides a summary of the number of respondents and 
corresponding percentages. The response rates varied over 50% for the three groups sampled. 
The lowest response rate was from SOS with 37 (15%) of the 254 surveys retizmed. Of the 37 
returned, 19 were usable. Fifteen of those 37 returned were received later than the timeline 
allowed for use in the analyses. Three of the 37 surveys were completed by someone other than 
the superintendent and were judged inappropriate for analyses. For the DOSE 79 or 32% of the 
251 mailed surveys were returned and 73 were usable. Two of the surveys mailed to DOSE 
were completed by someone other than the director and were judged inappropriate for 
including in the analyses. The general rule for excluding surveys on the basis of the 
respondent was whether the staff judged the respondent to likely represent the particular 
viewpoints of the desired group. For example, an assistant superintendent was judged likely 
to represent the views of the central administration and was thus included. Alternatively, 
responses from teachers and school principals were judged as likely reflecting a different set 
of values for either group and were omitted. The PTT returned 200 surveys (66%) of the 305 
mailed of which 173 were usable in the analyses. The remainder were received later than the 
established cutoff date. 

Returned surveys for the three groups were coded to indicate the respondent's group, were 
given identification codes for tracking purposes, and were checked for ambiguities. 
Subsequently, other than those surveys omitted due to the respondent, the surveys were coded for 
data entry. Responses were entered into a data base for categorizing and nominal coding. 
The data base identified each respondent's group membership, identification code, and 
responses to Parts I, II, and III of the survey. 
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Table 3 

Mailing Targets and Resnondftnts for the Elicitation Survey 



Number of surveys 



DOSE 



SOS 



PTT 



Mailed 



251 



254 



305 



Tot^l returns 



79 



37 



200 



Returns usable 



73 



19 



173 



Returns unusable 



6 



18 



27 



Nfitfi. DOSE = Director of Special Education; SOS = Superintendent of Schools; 
PTT = Pre-Service Teacher Trainer. 



Data cate gorizing . Four steps were followed in the content analysis of the survey 
responses. The staffs initial task was to review jointly a sample of the survey responses and 
identify conceptual categories in which the responses could be grouped. After several 
iterations on this task, specific categorical groupings were identified with accompanying 
exemplars. These categorical gi'oupings were the basis for coding the responses from all the 
respondents. A listing of the final categories used for data coding is provided in Table 4 
(Attributes of Successful Special Education Programs), Table 5 (Activities of Special Education 
Programs), Table 6 (Attributes for Evaluating Teaching Staff) and Table 7 (Activities of Pre- 
ser\'ice Training Programs). These attributes and activities are not arranged in any 
particular order and, therefore, ordinal position does not have intrepretative meaning. To 
summarize, 40 categories were identified for Part I-A of the survey, 28 for Part I-B 23 for Part 
II-A, and 18 for Part II-B. 
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Table 4 

Unranked Attributes of Successful High School Special Education Proerranis for Students with 
Mild to Moderate Handicaps. Identified from Responses of DOSE. SOS, and PTT 

Program attributes 



1. Individualized, appropriate 

2. Multi-disciplinary approach 

3. Regular education support and 
integration 

4. Counseling and guidance 

5. Vocational assessment 

6. Curriculum scope and sequence 

7. Basic academic skills 
curriculum 

8. Life skills curriculum 

9. Post-secondary transition 
curriculum 

10. Current research implementation 

11. Community-based program 

12. Vocational-career orientation 

13. High school completion 

14. Successful academic 
achievement 

15. Employment success 

16. Successful personal and social 
adjustment 

17. Successful independent living 

18. Student satisfaction 

19. lEP goals met 

40, Validated 



20. Case management sj'-stem 

21. Compliance standards 

22. Cost-effective 

23. Student-teacher ratio 

24. Effective staff 

25. Monitoring and assessment 
system 

26. Promotes professional growth 

27. Program support from staff, 
parents, business, and community 

28. Adequate physical plant 

29. Adequate community resources 

30. Adequate supplie^>, materials, 
and equipment 

31. Humanistic approach 

32. Competency based approach 

33. Defined philosophy 

34. Personal, social skills curriculum 

35. Age-appropriate curriculum 

36. Administrative leadership and 
support 

37. Study skills; learning strategies 

38. Functional academics 

39. Comprehensive program 
instructional methods 



1M£. DOSE = Director of Special Education; SOS = Superintendent of Schools; 
PTT = Pre-service Teacher Trainer. 
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Table 5 

Unranked Activities of Quality Special Education Programs for High Schoo] Students with 
Mild to Moderate Handicaps. Identified from Responses of DOSE, SOS.and PTT 



Program activities 



1. Basic skills instruction 

2. Physical education instruction 

3. Independent living skills instruction; 
Home Economics; Industrial Arts 

4. Driver*s education instruction 

5. Regular and adapted vocational 
education 

6. Prevocational career education 

7. Work-study program 

8. Social skills instruction 

9. Guidance and counseling services 

10. Learning strategies instruction 

11. Academic assistance for 
mainstream classes 

12. Inclusion in regular school activities 

13. Inclusion in mainstreaming classes 
14. Individualized instruction 



15. Peer tutoring and peer counseling 

16. Functional academics instruction 

17. Vocational assessment 

18. Community based instruction 

19. Transition planning 

20. Speech and communication 
instruction 

21. Computer assisted instruction and 
training 

22. Hands-on materials and activities 

23. Fine arts instruction 

24. Work adjustment and work 
activities 

25. Job placement program 

26. Behavior modification plans 

27. Parent/employer involvement 

28. Assessment plan 



IMfi. DOSE = Director of Special Education; SOS = Superintendent of Schools; 
PTT = Pre-service Teacher Trainer. 
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Table 6 



SOS, nnd PTT 



Teacher attributes 



1, Curriculum and instructional 
planning skills 

2, Instructional skills 

3, Innovative instruction skills 

4, Knowledge of transition 

5, Classroom organization skills 

6, Time management skills 

7, Behavior management skills 

8, Works cooperatively with 
and administration 

9, Works well with people 

10. Consultation skills 

11. Background training and 
experience 



13. Pursues professional development 

14. Personal characteristics 

15. Assessment skills for planning 

and instruction 

16. Counseling skills 

17. Philosophical position 

18. Teaches study skills; learning 
strategies 

19. Teaches basic skills 

20. Skill in assessing outcomes 

21. Teaches survival skills 

22. Incorporates vocational/career 
education 

23. Teaches personal-social skills 



Note . DOSE = Director of Special Education; SOS = Superintendent of Schools; 
PTT = Pre-service Teacher Trainer. 
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Table 7 

Unranked Pre-Service Training Activities for Teachers of Quality Special Education 
Pro-ams for High School Students with Mild to Moderate Handicaps, as Identified from 
;ofPTT 



Pre-service teacher training activities 



1. 


Student teaching activities 


10. 


Modeling and demonstration 


2. 


Lecture coursework 


11. 


Large and small group discussions 


3. 


Curriculum development 


12. 


On-going assessment 


4. 


Formal and informal seminars 


13. 


Individual advisement or 


5. 


Simulations 




conferences 


6. 


Videotape and media usage 


14. 


Computer assisted instruction 


7. 


Clinical teaching 


15. 


In-service activities 


8. 


Observational activities 


16. 


Group experiences 


9. 


Oral presentations by students 


17. 


Research experience 



18. Case study presentations 



Note . PTT = Pre-service Teacher Trainer. 



Some responses to Parts I and II were altered from the actual responses when they were 
added to the database listing. These alterations were either through use of abbreviations (e.g., 
"sped stu" for "special education students") or elimination of redundant or unessential 
verbiage. Responses which were repetitions of the responses provided in the survey's example 
were also eliminated. These terms most frequently occurred in Part I-A. Such terms as 
reliable, valid, objective, and efficient were used in the example which introduced the task. 
Project staff chose to drop such responses from further analyses since they seemingly had little 
relationship to the material desired in the survey or appeared to be merely repetitions from the 
examples. 

The second task was for two staff to assign independently a numerical code 
corresponding to a particular category for each of the responses. Thus, the responses to Part I-A 
concerning the attributes of a successful special education program were classified as 
belonging to one or more of the 40 nominal categories identified for this part of the survey. For 
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example, survey responses which concerned an individualized educational program for the 
student was coded as a "1." This coding process was followed for Parts I and II of the survey. 

Third, the two staff members* codings of the data were compared and discrepancies in 
coding were marked. As a last step, the two staff members met and reconciled the differences 
in the coding so that they agreed. Three possible decisions were made: 1) a response was 
grouped into a specific category, 2) the response was classified as belonging to more than one 
category, or 3) the response was eliminated because of a lack of information for categorizing 
the response, i.e., irrelevant or insufficient information. Responses could be included in 
more than one particular category for each respondent. Also, a respondent may have included 
several responses which were grouped in the same category. For example, a respondent could 
have listed several attributes which were each categorized as belonging to one category, e.g., 
from Part I-A, #1: Individualized, appropriate education. 

The classification procedure also proved problematic for the DOSE and SOS iccponses to 
Part II-B. This part asked DOSE and SOS to list "those activities on which a special education 
teaching staff might be evaluated." Some respondents did not distinguish the intent in Part II- 
A concerning attributes on which staff might be evaluated from activities desired in Part II-B. 
These items were thus eliminated for the DOSE and SOS, and Part II-B of the survey was 
rewritten prior to distribution to the PTT. As indicated, the rewritten directions asked PTT to 
identify those training activities or experiences judged important for teaching the desired 
teacher attributes. 

However, some PTT data from Part II-B also posed a problem. A frequent response to the 
task was not the listing of an "activity." Rather, the respondents named content or a course 
title, e.g., sex education, motivation, behavior modification, philosophy of education, 
community-based instruction, interpersonal skills with teachers and parents, curriculum 
adaptation, professionalism, learning strategies instruction, movie and story telling, reading 
instruction, language development training, and daily living. This content was different 
from the desired response. Again the desired response woxild have indicated not content per se, 
e.g., "coursework in reading instruction," but rather what activities are used to teach the 
content in pre-service programs, e.g., reading instruction. The activities listed on Part II-B 
are in Table 6 and contrast with the content material named above. To accommodate this 
disparate data, responses were included under category #2: Lecture coursework, if the 
respondent linked the content to a lecture presentation by the instructor. 

Inter-rater agreement. As a check on the congmity between the two staff members' 
categorizations of the responses, a sample of responses were independently categorized by each 
person. In December, 1987, six months after the first data were categorized, the two staff were 
given a list of 95 responses from Part I-A for categorization. Part I-A had the greatest number 
of categories in which responses might be categorized. Each staff member independently 
categorized the 95 survey responses and provided the listing to a third staff member who then 
compared the responses for agreement. An agreemen t was indicated by each staff member 
using the same numerical index for classifying a response. Some of the responses were 
categorized as belonging to two or more categories. Agreements were reflected in the 
sameness of the response's categorization. 

Data analysis. Analyses of the categorized responses involved calculating frequencies 
and crosstabulations of the categorical groupings by respondent group (i.e., DOSE, SOS, and 
PTT). Responses were also crosstabulated by school district setting (rural, urban, and ' 
suburban) and enrollment size. Initial analyses of the PTT survey responses were ungrouped 
and then crosstabulated according to whether the college/university offered (1) a separate 
methods course and (2) a practicum for teachers hoping to work in a high school setting. 
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Results 



Results are presented in two sections. The first brief section describes the extent of 
agreement between the two staff who categorized and coded the survey responses. The second 
section presents the frequencies with which particular categories were cited by the respondents. 
The attributes elicited regarding the program attributes and activities and staff attributes and 
activities are presented. The frequency with which a category is represented might be 
interpreted as an indicator of its saliency to the respondents. 

Inter-rater AgrreftTnent 

Of the 95 responses which the two staff members categorized, the two members categorized 
79 responses or 83% into the same category. The level of agreement reflected differences in 
which categories were considered emphasized by the responses. For example, an agreement 
was indicated if a response, (e.g., individualized educational programs for students), was 
categorized into the same nominal grouping by both staff members, (e.g., individual, 
appropriate). 

Program Attributes 

From the 40 program attributes. Table 8 lists the ten most frequently cited attributes by 
DOSE, SOS, and PTT. The results were pared to only ten attributes and activities to provide a 
parameter which focuses the discussion on a limited subset and to permit clearer comparisons 
across the participants' groups than what would be possible if all of the attributes and activities 
had been considered. In addition, the reader should find this presentation clearer than having 
to follow a discussion of significantly more concepts. In Table 8, the attributes are listed in the 
left column. The remaining columns include the rank position and the percentage of 
respondents for each group who included the corresponding attribute. The rank position was 
determined according to the percentage of respondents who included that attribute. The higher 
the percentage of inclusion, the smaller the numerical value of the rank, i.e., the most 
frequently cited attribute was assigned the rank of "1." 

Given the focus of the research, the DOSE were chosen as the reference group and thus 
their responses were coded in the first column followed by the rank of the attribute and the 
percent of DOSE who cited a given attribute. The rank order and percentage of SOS and PTT 
who cited the attributes are given in the adjoining columns. None of the ten most frequently 
cited program attributes were cited by 50% or more of any group's respondents reflecting a 
diversity of viewpoints. 

HOSE. Our comments will first address the ten attributes most frequently cited by the 
DOSE. The most frequently cited program attributes are those which focused on program 
descriptors, e.g., individualized, appropriate programming, regular education support and 
mtegration, broad range of program support, an effective staff, a monitoring system of student 
performance and a multi-disciplinary approach. In addition, two of the high frequency 
attributes focused on potential outcomes of the programs: (a) high school completion and 
(b) employment success. The two remaining attributes were curricular areas or content: 
(a) vocational/career orientation and (b) life skills curriculum. One should note that from 
these responses, the first four most frequently cited attributes were "process" descriptors and 
not "product" or outcome descriptors. Also the outcome goals were not totally consistent with 
• the curricular content cited. 
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SOS. The 19 SOS were very similar and also very dissimilar from the DOSE in their 
descriptions of program attributes. The similarity was evidenced in that six of their ten were 
cited by the DOSE. The top five most frequently cited attributes were the same five most 
frequently cited by the DOSE. However, marked differences were also noted. Dissimilarities 
were observed in that no SOS included "effective staff' as an attribute and that only one 
included "employment success." 

Among the SOS's top 10, five attributes can be described as program descriptors (i.e., 
regular education support and integration, individualized, appropriate programing, broad 
range of program support, a multi-disciplinary approach, and a case management system). 
In contrast to the DOSE, who listed only two outcomes, the SOS included four attributes 
referring to program outcomes, (i.e., high school completion, successful academic 
achievement, student satisfaction, and successful independent living). However, again note 
that "employment success" was cited by only one respondent. The one other attribute among 
the ten high frequency attributes concerned curriculum content, vocational, career 
orientation, which was an attribute also included by the DOSE. Some readers may also prefer 
to consider the attributes "successful independent living" as a curricular area, but within the 
context of the responses the staff distinguished such statements ab a goal rather than content 
unless it specifically referenced one or the other. By analogy, one might question whether 
mastery in a content area, e.g. reading or writing instruction, is a goal in itself or rather a tool 
for acquiring, integrating, and using other information, e.g., completing an application or 
order form. 

£11. The PTT's ten most frequently cited program attributes were more like those 
listed by the DOSE than the SOS. Eight of their ten attributes were the same as those cited by the 
DOSE. Like the DOSE, most of the PTT's -ttributes fit the program descriptor category, i.e., 
individualized, appropriate programming, monitoring assessment system, regular education 
support and integration, broad range of program support, a multi-disciplinary approach, and a 

community based program. Three curricular content areas were cited: vocational, career 
orientation, life skills curriculum, and personal, social skills curriculum. Clearly, the PTT 
were much more interested in curricular issues than outcome descriptors and even mere so 
than either the DOSE, who included only two curricular areas, vocational, career orientation 
and life skills curriculum, and the SOS, who included only one, vocational, career 
orientation. Both curricular areas cited by the DOSE were included in the PTT's listings. 

Program ActivitiP.R 

The responses described from this section of the survey were activities or content 
components which one would want to evaluate in a special education program for students with 
mild to moderate handicaps. Therefore, the program activities focus on process or content 
which is offered through the program. In Table 9 the same format is followed in presenting 
these data as was followed above in presenting the program attributes. Responses from the 
DOSE, SOS, and PTT are presented respectively. A total of twenty-eight different program 
activities were identified from the participants* responses. 
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DOSE . The "top ten" includes eleven activities because of a tie in the percentage of cites 
for the tenth activity. Among these 11 DOSE responses seven were curricular areas, i.e., 
regular and adapted vocational education, independent living skills instruction, basic skills 
instruction, career education, learning strategies instruction, social skills instruction, and 
computer assisted instruction and training. One attribute, regular and adapted vocational 
education, was cited by over 50% (58%) of the DOSE. The remaining four of 11 activities were 
program descriptors: work study program, academic assistance for mainstream classes, 
individualized instruction, and inclusion in regular school activities. 

Among these activities the percent of DOSE citing them ranged from 58.9% (43 of 73) to 
15.1% (11 of the 73). Interestingly, the activities included a variety of themes. That is, the 
curricular content areas were heterogeneous, Basic skills instruction is not inherently 
mutually exclusive of independent living skills instruction, but different goals traditionally 
are sought for each curriculum. Similarly, inclusion of career education and of both regular 
and adapted vocational education reflect different values and goals for education. In the 
section under program attributes, DOSE also included similar concepts: individualized 
appropriate educational planning, vocational, career orientation, and life skills curriculum. 
The repetition of these concepts across different sections of the survey suggests that these 
concepts are very salient in the respondents' thinking. 

SOS. The SOS included similar rankings as the DOSE. The SOS cited eight of the same 
eleven incluu.d by the DOSE. Even more specifically, the groups cited the same top four 
activities. Also, a four way tie for the eighth most frequently cited activity resulted in eleven 
activities being included. Six of the 11 included curricular content areas: regular and 
adapted vocational education, independent living skills instruction, basic skills instruction, 
career education, social skills instruction, and speech communication instruction. This last 
content area was not in the DOSE's top eleven. Conversely, the DOSE included computer 
assisted instruction and training, but no SOS cited it. The remaining elicited activities were 
program descriptors: work study program, academic assistance for mainstream classes, 
individualized instruction, inclusion in regular school activities, and inclusion in 
mainstream classes. 

The most frequently cited activity category was basic skills instruction with 42.2% of the 
SOS including an activity grouped in this category. The percentages for the top ten ranged 
from 42.1% (8 of 19) to five activities which were tied with 10.5% (2 of 19). The low response rate 
from this group poses several interpretation problems concerning stability and generalization 
of these results. 

Ell. The PTT included nine of the same eleven program activities as did the DOSE in 
the most frequently cited activities. The PTT's seventh and ninth activities were not included 
in the DOSE's listing. Their top eleven included seven curricular content areas: regular and 
adapted vocational education, independent living skills instruction, basic skills instruction, 
career education, learning strategies instruction, social skills instruction, and functional 
academic instruction. The remaining four activities were program descriptors: work study 
program, academic assistance for mainstream classes, individualized instruction, inclusion 
in regular school activities, and community based instruction. 

As with the other response groaps, opinions diverged on the appropriate curricular content. 
Indeed, the five most frequently cited activities were different curricular content areas. 
Independent living skills was the most frequently cited activity with 59% (102 of 173) of the 
PTT alluding to it. Similar to the SOS, the PTT infrequently cited computer assisted 
instruction and training as k program activity (2.9%). The range of percentages among the 
top eleven activities was from 59% to 12.7% (22 of 173). 
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A variety of teacher characteristics have been identified as important. The results of the 
Elicitation Sixrvey include those attributes which were identified by DOSE, SOS, and PTT. 
Each groups' ten most frequently cited diaracteristics will be reported respectively. Recall 
that a total of 23 staff attributes were identified from the survey responses. The ten most 
frequently cited attributes are listed in Table 10. The attributes are listed in the left column. 
The remaining columns include, respectively, the rank position and the percentage of 
respondents for each group who included the corresponding attribute. The rank position was 
determined according to the percentage of respondents who included that attribute. The higher 
the percentage of inclusion, the smaller the numerical value of the rank, i.e., the most 
frequently cited attribute was assigned the rank of "1." 

DOSE . The DOSE s ten most frequently dted attributes fit into two broad categories. The 
first group included attributes which might be considered personality characteristics, and thus 
less amenable to the influence of a teacher training program. In the second group were 
characteristics which concern instruction or training- The range in percentages was 78.1 to 
24.7. Three of the four most frequently cited characteristics suit the category of personality 
characteristics. Those attributes and corresponding percentage of citations are as follows: 
personality characteristics (78.1), works well with people (53.4) and works cooperatively with 
staff and administration (47.9). "Personality characteristics" was a category in which a 
number " diverse teacher traits were grouped: honesty, good judgment, dependable, loyal, and 
so on. The remaining seven concern skills or training: background training and experience 
(58.9), classroom organization skills (46.6), instructional skills (46.6), curriculum and 
instructional planning skills (42.5), assessment skills for planning and instruction (27.4), 
consultation skills (27.4), and behavior management skills (24.7). If the respondent included 
knowledge or content information regarding particular subject areas, e.g., social skills, 
transition, learning strategies, basic skills, and so on, the response was categorized into 
background training and experience. This attribute thus included a diverse set of 
information. 

SOS. Although the rankings differed, the ten teacher attributes most frequently cited by 
the SOS included the same ten included by the DOSE. In addition, both groups identified 
personal characteristics as the most important attribute. The SOS included another attribute 
due to a tie in the number ten rank: Innovative instructional skills (10.5). The range of 
percentages was from 57.9% for personal characteristics and for instructional skills to 10.5% 
for consultation skills and for innovative instructional skills. 

EH. The PTT included the same top nine attributes as the DOSE in their top nine most 
frequently cited attributes, although not in the same order. Classroom organization skills 
which was included by both DOSE and SOS as their fifth most cited attribute was at the twelfth 
rank for the PTT. Philosophical position was their tenth attribute. The range of percentages 
was narrowest among the three groups for the PTT. This range was from 55.5% for 
instructional skills, which had the same rank for the SOS, to 23.1% for philosophical position 
in the tenth rank. 



NHS Ebdtation Survey 8/ 10/92 4 ]^ 



ERIC 



03 

S 
o 
'SI 
c 

> 

Xi 

ncJ 
<l> 

C 

<S 

P 

c 

CO 

0) 

CO 
^ 

O 



2 
I 

CO 

C 

a> 

CO 

"o 
o 

o 

CO 

-SI 



c2 



CO 

Eh 

C 

o 

CO 
u 

W 

'o 

p 

CO 



CO 

O 



(1) 



!3 



CO 



rH 

ii 

CO 

o 

CO 
00 

t> 
II 

3 
w 

CO 

o 



CO 

c 

o 
CO 

W 

e 

o 



Eh 

Eh 



CO 

o 

CO 



w 

CO 

O 
Q 



CO 
•4-) 

CO 
CO 



c 

CO 



c 

CO 



CO 


00 


00 




(N 




CO 


t> 




00 


o 






ci 


CO 




iri 


00 


I> 


irS 


lO 






CO 


rH 




CO 


CO 


(N 


CO 






* 
















(N 


CO 


CO 


00 


S3 


tH 


o 


iO 




CO 






T-H 




00 


a> 


00 


CO 


iO 










rH 




t> 




CD 


o 






lO 




CO 


CO 


in 


CO 


(N 


T-H 


<N 


* 








* 


* 


* 




* 






CO 




o 




T-H 




00 


o 







T-H 






as 


CO 


CO 












00 


00 


00 




CO 


CO 


<N 






^' 


Rank 






















tH 




CO 










* 

00 


* 

00 


s 



o 
C 

a> 

a 

C 

CO o 



u 

O 

CO 
CO 
o 

c 

o 

CO 
0) 

Cl, 



CO 

C 

o 

o 
CO 



a 

o 

a 



CO 

o 



CO 



i i 

> CO 
o 



— C 

77: o 
bx) S 

CO 

c c 
c 



CO 



C 
o 



CO 



C 

CO 

o 



o 
o 

CO 
CO 

CO 

r— ♦ 

o 



CO 



CO 
C 
o 
'•13 
o 

I- 

CO 

C 



CO 

c 
o 

*^ 
o 

CO 

C 

C 

CO 

6 
'5 



o 



bx) 
.E 

c 

CO 



c 

e 

CO 
CO 
0) 
CO 
CO 



CO 

c 
o 



CO 

c 

o 

o 



CO 



C 

e 

o 
bJD 
CO 
C 
CO 

6 

u 
o 

*> 

CO 



c 

o 
o 

CO 

.5 
> 

CO 
> 
o 
c 
c 



CO 

o 

CO 

CO 

V 



c 

I 

a 

o 



CO 
0) 

CO 



o 



CO 



C 

o 



o 
p. 



CO 



s 

CO 

c 
c 
'5 

1 
CO 

£ 

52 



ERIC 



Staff Activities 



As described previously in the procedures section, teacher training activities are limited 
to those activities reported by the PTT. Table 11 lists the presePidce training activities for 
quality special education staJEFby percent of cites from PTT respondents. The top two activities, 
student teaching (53.2%) and lecture course work (34.7%) were more frequently included than 
any of the other activities. Recall that specific content courses were categorized separately but 
rather were included under the grouping of lecture course work. The list includes a disparate 
range of trmning activities suggesting that multiple settings and media are appropriate to pre- 
service instruction. However, if the percentage of citations is considered as an indicator of the 
frequency of usage or of familiarity, the response patterns suggest that the variations in 
training activities are reduced and few of these alternatives actually are used. 



Table 11 

£l£-SerYice Teacher-Training Activities for Quality Special Education Programs for High 
Sdiool Students with Mild to Moderate Handicaps, Listed bv Percent of Cites from Elicitation 
Survey of PTT 



Teacher-training activities 


Rank 


(% Cites) 


Student teaching 


1 


(53.2) 


Lecture coursework 


2 


(34.7) 


Observation activities 


3 


(20.2) 


Curriculum development experiences 


4 


(19.7) 


Simulations 


5 


(13.9) 


Research experiences 


6 


(10.4) 


Videotape/media uses 


7 


(7.5) 


Clinical teaching 


8* 


(5.8) 


Modeling/demonstrations 


8* 


(5.8) 


Computer assisted instruction & training 


10 


(4.0) 



Note * indicates a tie. PTT = Pre-service Teacher Trainer. 



NHS ElicitAtion Survey 8/10^2 



43 



DiscufisiQP 



The National High School Project was initiated to provide policy makers at the federal, 
state, and local levels with information to design and evaluate the quality of special education 
programs serving youth with mild to moderate handicaps. Three major research efforts were 
completed as part of the National High School Project. This report describes the results of a 
series of five surveys which examined multiple perspectives on the desired attributes of high 
school special education programs and staffs. This first survey was designed to elicit desired 
attributes of special education programs and teaching staff for students with mild to moderate 
handicaps. 

Many perspectives could be appropriately included in a project with this goal. The three 
respondent groups (directors of special education, superintendents of schools, and pre-service 
teacher trainers) were selected because of their close relationship with the policies and 
practices in special education, to complement the work completed in the project's two other 
research efforts (which are reported in Bodner et al, 1987 and Knowlton and Clark, 1989), and 
lastly, because they could be chosen through a probability sampling procedure. 

The results of this first survey present a study of contrasts. The contrasts are represented 
among the respondent groups and the varied responses within each group. Obviously, the 
diversity of responses elicited through the open-ended format indicates that the programs serve 
a variety of needs through heterogeneous formats of instructional delivery. 

Program Attributes . As one might expect, the responding groups' perspectives of quality 
programs were characterized by characteristics of the programs, not outcomes. For example, 
in reviewing the ten most frequently cited attributes, the DOSE included eight regarding the 
characteristics and two regarding outcomes ("High school completion" and "Employment 
success'). For SOS, six attributes concerned program characteristics and four were on 
outcome content ("Successful academic achievement," "Successful personal and social 
adjustment," "High school completion," and "Student satisfaction"). The PTT included nine 
program characteristics and one outcome ("Employment success"). Perhaps the 
administrative orientation of the responding groups prompted this pattern of attributes. The 
perspective may be that if the process of education is a good one, the outcomes will also be good. 
However, the question not addressed is that processes may be very good, i.e., the programs may 
be in legal compliance, have good discipline, and be well structured, but fail to deliver a valued 
outcome. The point is that accountability or quality needs to be assessed against agreed upon 
standards. Attributes which characterize programs must shift to standards emphasizing the 
knowledge, skills, and abilities which the students have upon completion rather than 
immediate concerns with pedagogy or intermediate goals of the program, e.g., 
mainstreaming students or merger or integration of regular and special education faculties. 
Only after those desired outcomes are specified can one come to understand the role of various 
program characteristics, the process variables which influence those outcomes. An 
alternative should also be considered. The frequency of program characteristics' inclusion 
may signal two different issues. Perhaps, those desired outcomes are clearly perceived in our 
respondents and the survey's format did not elicit that information. Subsequent procedures in 
this research lend themselves to closer evaluation of that perspective. 

Program Activities. Activities most frequently cited by DOSE, SOS and PTT as 
characteristic of quality special education programs anticipated the mild to moderately 
handicapped high school student's transition to adult participation in the community (viz., 
"Regular and adapted vocational education," "Work study program," and "independent 
living skills instruction"). Less transition-oriented activities (e.g., "Inclusion in regular 
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school activities," "Computer assisted instruction & training," "Social skills instruction") 
were among the lowest of the top ten rankings. This recognition among the three respondent 
groups of the importance of the transition from high school to adult living among special 
education students has wide ranging implications for special education programs and staff. 

StafiF Attributes . Some parallel observations are relevant between the staff and program 
attributes. The vast majority of teacher attributes were those concerned with delivering 
instruction and management. Only six of the 23 teacher attributes described content areas 
Ocnowledge of transition, study skills; learning strategies, basic skills survival skills, 
vocational/career education, and personal-social skills). Interestingly enough, none of the 
ten most frequently cited characteristics by any of the groups included one of these six content 
areas. As with program characteristics, these frequency listings indicate the difficulty with 
selecting suitable goals or a focus for the special education programs. The more agreed upon 
characteristics are process or pedagogical. The respondents articulated how they would like 
the programs and staff to "look," but were less agreed upon the long range goals or content for 
the programs. Certainly content is an area to which neither federal nor state agencies have 
added direction beyond the position that each student should have access to an individualized, 
appropriate education. 

Pre-service Training Activities . The pre-service training activities were limited in 
number. Of the four areas surveyed, this survey elicited the fewest categories of responses. 
This narrow grouping may be due to only pre-service teacher trainers completing the survey. 
Since this area is their expertise, their knowledge and experience may have limited the 
possible considerations of alternative activities. Perhaps, the non-experts, e.g., SOS and 
DOSE, would have other recommendations that they believe are valuable in teacher training. 
Given the rankings of the desired staff attributes, we are curious how those desired attributes 
can be developed through the training activities. 

Limitations . Initial plans were to examine the DOSE' and SOS' responses on such 
indices as the setting in which the respondent works, e.g., rural isolate, rural, urban, or 
suburban, and the enrollment size of the school district or cooperative. However, with so few 
responses irom the SOS, such analyses were judged inappropriate. Indeed, the larger issue 
concerns the representativeness of the SOS's sample. If the assumption is valid that the SOS 
received the survey, was the low response rate due to a perceived lack of importance, a lack of 
information on which to base a response, or some combination of these two and other factors? 
The low response rate also poses the interpretation problem in that each SOS represented 5,3% 
of the total. In this case the level of confidence that a reader might have in knowing that 50% of 
the SOS responded in a particular manner should be significantly less than the level of 
confidence attached to DOSE responses. The sample sizes warrant these shifts in confidence 
levels, 

A second issue concerns the respondents' interpretations of the survey. Despite a 
successful pilot test, the directions to the respondents apparently were not understood. 
Generally this issue was with the second part of the two sections. For many respondents, the 
concept of an activity was not adequately conveyed. That is, they did not distinguish the goals 
or desired attributes of a special education program or teaching staff from the activities in 
which one might engage to realize those attributes. In some instances the outcomes or 
attributes were confused with the activities. 

As a consequence of both of these issues, the data from this first survey should be treated 
as very tentative. On the other hand, the authors feel comfortable that the identified attributes 
and activities are quite exhaustive of their respective domains. Our caution is in interpreting 
these data as representative or a consensus of the responding groups. 
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AppendixA 

Initial Letter to Qiair of Special Education Department at 
Institutions of Higher Education 
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September 17, 1986 



National Study 
of High School 
Programs for 
Handicapped 
Youth 



Garu M. Clark 

(913) 8t>4-4^.^i 

Don Dorset/ 
Research Coordifhiicr 

(9Ut So4-49^4 

H. Earle Kuowltott 
Research A><t\u}tc 
tci]-u St>4-49!^4 

DaryU, \1cllarti 
joannc R. Bod tier 



«department » 

«college» 

^address» 

^city,» ^State» «zip» 
Dear ^greet»: 

The National High School Project is a joint effort of the Office of Special Education 
Programs and the University of Kansas to examine factors influencing the 
transition of high school students in special education to independent adult 
functioning. The Teacher Education Division of CEC is a "silent" co-sponsor of 
this project, having gone on record to support it and encourage participation by all 
personnel preparation programs. 

We recognize that many reforms are occurring in regular education and special 
education. Such reforms will have influences in many areas such as curriculum 
development, instructional goals, competency testing, teacher pre-service 
education, and graduation requirements. We are particularly interested in 
learning about your pre-service program for training secondary level teachers of 
mild to moderately handicapped students. In a subsequent mailing, we will 
include a survey to learn more about your program. 

Our present request is that you complete the enclosed postcard. We would like you to 
send us the names of faculty members who are interested in your secondary level 
teacher preparation programs for students with mild to moderate handicaps. Thus, 
we can send our survey directly to them. If you would also like to receive the 
survey, add your name to the list. If no one on your faculty has an interest in this 
area, please so indicate on the postcard. 

We appreciate your thoughtful attention and speedy reply to our query. 
Sincerely, 



Gary M. Clark 
Enc. 



Daryl F. Mellard 



Don Dorsey 



The University of Kansas 
Department of 
Special Education 
377 Haworth Hall 
Lawrence, KS 66045-2330 
^ (913) 864-4954 
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ATTRIBUTES AND COMPONENTS OF SPECIAL EDUCATION 



The uniqueness of special education students and school 
districts' availability and allocation of resources have resulted 
in a diversity of high school level special education programs. 
We are interested in learning your thoughts about evaluation of 
special education (I) programs and (II) staff. The survey has two 
parts. In Part I we ask you to identify (a) attributes and 

(b) activities of special education programs. In Part II we ask 
for similar information concerning special education teaching 
staffs The following analogy , concerning a family's decision to 
buy a car, is offered to clarify our intent. 

In this example there are three family members who have a 
stake in the kind of car that is bought. As you might expect, 
each family member has her or his car preferences based on 
desired features or attributes. Mom wants a car that is 
(a) roomy, (b) easy to drive on snow packed streets, and (c) easy 
for loading and unloading. Dad's concerns are with the car's 
(a) maintenance record, (b) initial cost, (c) miles per gallon 
and (d) riding comfort. Their teenager is interested in the 
car's (a) 0 to 55 acceleration rate, . (b) "sporty" look and 

(c) rated horsepower. 

These three family members have different attributes or 
characteristics on which they will evaluate different car models, 
e.g.. Dodge's Caravan, Mazda's RX-7, Oldsmobile's 98, Chevrolet's 
Camaro, and Chyrsler's Newport. For the family to decide on which 
car to buy, the members might order their preferred attributes in 
importance and then compare each car model on each of them. The 
car model with the highest rating across the attributes would be 
the rational choice. 

For our task, we are interested in the attributes you 

believe important for evaluating activities or components of 

secondary level special education programs (Part I) and 
characteristics and skills of teaching staffs (Part II). 



1 



Part lA: Attributes of High School Special Education Programs 



We offer a second analogy to further illustrate this task. 
In this example^ assume that one is to evaluate a school 
district's comprehensive student assessment procedures. Those 
evaluations might be assessed on the following attributes ; 
(a) multi-sourced, (b) reliable, (c) objective, (d) cost- 
effective, (e) valid, (f) multi-disciplinary, and 
(g) efficient. 

In this part your task is to write those attributes for 
evaluating the success of a high school special education program 
for the mildly to moderately handicapped students such as yours. 

Please write the attributes on the lines below. 

A) ^^ 

B) 

C) 

D) 

E) 

F) 

G) 



H) 



Additional comments : 



(OVER PLEASE) 



6G 
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Part IB: Activities of High School Special Education Programs 



A variety of activities, options or components are included 
in secondary level special education programs for students with 
mild to moderate handicaps. We are interested in what components 
or activities you would consider important to evaluate in your 
special education program. This list would be the content or 
what s offered in your programs. We recognize that this includes 
a wide range of activities e.g., work-study programs, reading 
instruction, and independent living skills. Include on this list 
those alternatives that are available to students. By way of 
example, consider the components or activities which might be 
included in a driver's education program: (a) actual driving 
practice; (b) use of automobile simulators, (c) textbook usage, 
(d) safety films, and (e) written tests. These options could be 
evaluated against a set of attributes (e.g., safety record, 
success at passing driver's test, influence on number of ticket 
violations) to determine which activities have the greatest 
impact on the attributes of interest. 

On the following lines, please write the activities or 
components that are part of your special education programs for 
mildly and moderately handicapped students. 

A) 

B) 

C) 

D) 



E) 
F) 
G) 
H) 



Additional comjnents: 



Part IIA: Attributes of High School Special Education Teachers 



We are likewise interested in learning those attributes on 
which special education staff might be evaluated. On the lines 
provided, please write those attributes on which you would 
evaluate special education teaching staff of mildly to moderately 
handicapped students. 

A) 

B) 

C) 

D) 

E) 

F) 

G) __ 

H) 



Additional comments: 



(OVER PLEASE) 
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Part IIB: Activities of High School Special Education 
Teaching Staff 

Teaching staff complete a number of instructional and 
noninstructional activities on which they might be evaluated. On 
the following lines, please write those activities on which you 
might evaluate your teaching staff. Please focus on only 
activities of teachers of mildly and moderately handicapped 
students and not ancillary or related service personnel. 



A). 
B) 



F). 
H) 



Additional comments: 
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Part III: Some news about you 

Please check ONE; 

I am a school superintendent, 

director of special education* 

other, (Tell us.) 



The region in which I work might be best characterized as: 

rural, isolated geographically and sparsely 

populated 

rural, small town 

suburban 

urban 

Please complete ONE of the following statements; 

i* What is the total enrollment in your school 
district? ^ 

ii. If your service area includes a number of school 
districts, such as in a special education 
cooperative or interlocal, what is the total 
enrollment of those school districts? 



In what state is your office? 



In what county or parish is your office? 



Please return this survey to us by May 23rdi 
Thank you. 



5/08/36 
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November 11, 1386 

&NAME& 

&TITLE/Oi 

&ftDDRESSl/0& 

&ftDDRESS2/04 

&CITY&, &STftTE& &ZIP& 

Dear &GREET&: 

Dramatic changes are occurring in special education programs 
and teacher pre-service training. Impetus for these reforms 
is based in part on the need to provide secondary students 
with better transition from school to independent adult 
functioning. To understand the trends in special education 
programs, we need to likewise exanine the trends in teacher 
preparation programs. We are soliciting your assistance in 
understanding and evaluating high school level special 
education programs and teacher preparation programs. 

Our task, a survey, will likely reauire between 23 and 30 
minutes of your time because we have designed it for brief, 
open-ended answers. This allows you to identify the 
important characteristics of exemplary programs in secondary 
special education and staff training, and incorporate the 
uniqueness of your institution's philosophy and objectives. 
Your answers to these open-ended questions will be used to 
develop categories for a nation-wide survey of secondary 
special education teacher training and program practices. 
Because you are part of a carefully chosen sample, your 
responses are important. 

Efficiency experts claim that an excellent time management 
skill is to handle a piece of mail only once. From our 
perspective, we know that if it is set aside, you are less 
likely to complete it, even though your intentions are good. 
Will you complete our survey right now? 

We look forward to receiving your opinions and thank you for 
your prompt and careful attention to our survey. In addi- 
tion, we would be glad to answer your questions concerning 
the survey or the project if you would call or write us. We 
have enclosed an abstract of our research project for your 
further information, and a small token of our appreciation 
for your response. 

Sincerely, 



Daryl F. Mel lard Gary M. Clark Don Dorsey 



Enc. 



IHE tchrlet 11-04-87 



ATTRIBUTES AND COMPONENTS OF SPECIAL EDUCATION 

High school special education programs are highly diverse. 
We are interested in learning your thoughts about evaluating this 
diverse group of special education (I) programs and (II) staff, 
from your vantage point. Our survey has two parts. In Part I we 
ask you to identify (a) attributes and (b) activities of special 
education programs. In Part II we ask for similar information 
concerning special education teaching staff. The following 
analogy, concerning a family's decision to buy a car, is offered 
to clarify our intent. 

In this example, three family members are deciding which 
model of car to buy: (a) Dodge's Caravan, (b) Mazda's RX-7, and 
(c) Oldsmobile's 98. The chosen model will be the one which most 
closely matches the family members' attributes or desired 
features. Thus, it is important that those attributes be clearly 
understood. Mom wants a car that is (a) roomy, (b) easy to 
drive, and (c) easy to load and unload. Dad's concerns are with 
the car's (a) maintenance record, (b) initial cost, and (c) miles 
per gallon. Their teenager is interested in the car's (a) 0 to 
55 acceleration rate, (b) "sporty" look, and (c) horsepower 
rating. Thus, these attributes will play an important role in 
evaluating the different car models. 

We are interested in the attributes you believe important 
for evaluating high school special education programs (Part I) 
and characteristics and skills of teaching staffs (Part II). 
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Part lA: Attributes of High School Special Education Programs 



We offer a second analosy to further illustrate your task. 
In this^ example, assume that one is to evaluate a school 
district's comprehensive student assessment procedures. Those 
evaluations might be assessed on the following attributes ; 
(a; multi-sourced, (b) reliable, (c) objective, (d) cost-ef f ec- 
tive, (e) valid, (f) multi-disciplinary, and (g) efficient. 

In this part, your task is to write those attributes for 
evaluating the success of a high school special education program 
for mildly to moderately handicapped students. 

Please write the attributes on the lines below. Write as 
many or as few as you judge important. 

A) 



B) 
C) 
D) 

E) . 

F) . 

G) . 

H) . 



Additional comments; 



(OVER PLEASE) 
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Part IB: Activities of High School Special Education Programs 

A variety of activities, or content components are included 
in secondary level S{)eci3l education programs for students with 
mild to moderate handicaps. We are interested in what components 
or activities you would consider important to evaluate in a high 
school special education program. We recognize that this in- 
cludes a wide range of content and activities e.g., work-study 
programs, reading instruction, and independent living skills. 
Include on this list the content and activities which you believe 
important for students. By way of example, consider the compo- 
nents or activities that might be included in a driver's educa- 
tion program: (a) actual driving practice; (b) use of automobile 
simulators, (c) information on car maintenance, (d) information 
on driving safety, and (e) written tests. 

On the following lines, please write the activities or 
content components important to special education programs for 
mildly and moderately handicapped students. Write as few or as 
many as you judge important. 

A) 

B) . 

C) 

D) . 

E) 

F) 

G) 

H) 

Additional comments: 
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Part IIA: Attributes of High School Special Education Teachers 



We are likewise interested in learning those attributes on 
which special eaucation staff might be evaluated. On the lines 
provided, please write those attributes on which you would 
evaluate high school special education teaching staff of mildly 
to moderately handicapped students. Write as many or as few as 
you judge important. 



A). 

C) . 

D) . 

E) . 

F) . 

G) . 
H) 



Additional comments: 



(OVER PLEASE) 
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Part IIB: Activities of Training Programs 



In the previous section, you listed characteristics of a 
teaching staff. In this part, .ve are interested in the ore- 
service activities designed to develop or teach those character- 
istics . 



Please write those activities which are included or you 
believe should be included in your training program to develop or 
teach those characteristics* Write as many or as few as you 
judge important. 



A) . 

B) . 

C) . 

E) . 

F) _ 

G) . 

H) . 



Additional comments; 
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Part III. Some Infomacion About You and Your Prograta 
• . Program Questions 

Does yo'jr -jr.^ram require ,i separace .tietnods course -'o- --acn — a 
secondary level mild to rnoderaceiv nancicapped students^ * 

Yes No 



If Yes check all the categorical areas in which you provi.^e 
separate methods courses. ' H^^y^icc 

Mildly mentally handicapped (EMR, EMH) 

Behavior disordered ^ Learning disabled 

Other (Specify.) 

nr* . ^ prerequisite to secondary level certification. does your 

program require student teaching or practica in a high school setting? 

Yes No 

3 Throueh which program do most students acquire their certifica- 
tion m special education? 

Bachelors Post Baccalaureate (non-degres) 

Masters Specialist Doctorate 

III' B. Background Questions 



Ra^k Jrorder of°LM"^""' secondary special education? 

Kank in order of influence: I - most influential; 2 - second-most 
influential, and so on. 0 - no influence secono most 

Experience Training program 

Personal interest Research S Development Project 

Other (Specify) 



your tS'r'nardegrLf'^'' '^^'^ ^^^'^^^^ ^^"^ P-^ra. for 
Elementary ^ ^ Secondary 

Both (Percent in elementary Z) Neither 

10, What is your terminal degree? Circle one. 

Ed.S. cd.D. Ph.D. Other 



II. At what college or university are you currently employed? 



12, In which state are you located? 



{BA.Pc'''?BM^m'i^\n^ P^^^°"^\-°"^P*-^ter (e.g.. Apple He. Macintosh. 
itin t'L, IBM-XT) do you use regularly for word processing? 
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Survey 2: Banking Survey 



Overview 



High school special education programs provide the formal educational experiences for 
those students with disabilities who are unable to benefit from instruction in general 
education's instructional programs. These educational experiences include a disparate 
variety of instructional goals and activities, some of which are very idiosyncratic due to the 
learner's unique needs and goals. To date, these goals and activities have not been examined 
nationally or even integrated into a database for analysis. The National High School Project 
involved three research efforts, Bodner, Clark, and Mellard (1987) and Knowlton and Clark 
(1989) as well as the research described here. These efforts provide integrated, multiple 
perspectives on high schools' efforts to ensure the successful transition of students with mild to 
moderate handicaps to independent functioning within the community. The project's intent 
was to provide educators, researchers, and federal, state, and local level policy makers with a 
framework for evaluating and modeling special education programs. 

In this research effort of the NHS project, five surveys were completed. Each survey 
represented one step in a sequential process of a multi-attribute utility measurement. Through 
the surveys the respondents identified the desired attributes and activities of high school 
special education programs. Simultaneously, they identified the desired characteristics of a 
quality teaching staff with the types of training activities which would likely facilitate the 
acquisition of those attributes. These attributes and activities provide a common framework. 
This framework might be used by numerous groups for such activities as planning, 
evaluating, or further researching high school special education programs, their instructional 
staff, and pre-service teacher training programs. 

The results of the second survey, referred to as the ranking survey, are described here. 
This ranking survey followed an initial survey which was completed by directors of special 
education (DOSE), superintendents of schools (SOS), and pre-service teacher trainers (PTT). 
The initial survey, referred to as the elicitation survey, requested respondents to list (a) the 
attributes and (b) the activities which characterized quality special education programs for 
high school students with mild to moderate handicaps and also of quality teaching staff in 
those programs. The DOSE and SOS were asked to indicate the activities of teaching staff on 
which the staff should be evaluated. This task was altered for the PTT. On the PTT survey, 
respondents were asked to indicate the pre-service training activities which would develop ' 
those desired attributes. 

The first survey's responses from the 265 respondents were grouped into conceptually 
distinct categories by the project's staff. As a result of this categorization, 40 program 
attributes were identified. Similarly, 28 program activities, 23 teacher attributes, and 18 
tear .ler training activities were identified. Details of the methods and results are described in 
the previous section titled "Survey 1: Elicitation Survey to Directors of Special Education, 
School Superintendents, and Teacher Trainers." 

In proceeding with the initial plan to use the multi-attribute utility measurement 
(MAUM) methodology (Edwards, 1977), several decisions were required. One value of the 
MAUM is that the procedures yield two veiy important results. First, the procedures yield a 
ratio-leveled ranking of each attribute set. This ratio scaling permits very clear statements 
regardmg the respondents' expressed values. For example, one can discern the ratio between 
any two attributes and conclude whether one attribute is valued 2, 3, 4, or even more times than 
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another attribute. Such information is not available from Likert-type scaling or ranks. This 
information has importance for understanding implications. The second feature of the 
MAUM procedure comes through the utility measurement The utility measurement itself 
identifies those activities which are maximized using the defined attributes. That is, one 
knows which activity has the greatest value for maximizing a set of attributes. Xn proceeding 
with the MAUM methodology, several decisions were needed. Each of these decision points are 
described in the following section. 

Methodological Considerations 

The results of the first survey, the elicitation survey, were rather different than expected. 
The diversity of responses, the low response rate, and the large number of conceptual 
categories posed several interesting challenges to completing the project as planned. 

As Edwards (1977) outlined the sequence of steps in the MAUM procedures, the group of 
chosen attributes shoiild number no more than ten for the type of procedures available to this 
project. From the first survey 40 program attributes and 23 teacher attributes were identified by 
staff. Given the nature of this project, that a mail survey was used as instrumentation, and the 
number of activities that the respondents needed to evaluate, a group often attributes was 
judged as the maximum number of attributes to use in a survey. (If meetings could have been 
scheduled with groups of respondents, probably all of the attributes could have been used and 
refined with the participant's assistance.) Two questions were identified: Who should make 
the decision about which attributes should be included in the two top ten groupings and 
secondly, how should the lists of attributes be reduced to approximately ten in each listing? Ten 
attributes were needed for representing the desired program attributes and a second set often 
attributes was needed to characterize desired teacher qualities. 

One option was to use, respectively, the ten attributes which were most frequently cited in 
the first survey for programs and teachers. This option was rejected for several reasons. 
First, the low response rate led the staff to question the representativeness or reliability of the 
responses. Second, the characteristics of the survey may have prompted the responses and low 
response rate to be different than expected. The task was a listing task and as a generation or 
production task, more effort was required than on a recognition or sorting task. Thus, the task 
might have had an unintentional limiting impact. Third, the frequency counts, and the 
categorical groupings for that matter, were very dependent on the categorizations given to the 
responses by the project's staff. Some unknown bias may have incorrectly influenced the 
formation of the categories and hence the frequency counts. 

Another option would have been for staff to select the *T3est" attributes. However, for 
numerous reasons, external raters were considered as a more valuable group of respondents. 
Most importantly, external raters were considered as independent of the project and as 
representing significant perspectives on special education and teacher training. Thus, the 
staff judged that the desired respondents to the second survey'should be those professionals 
whose work provided them with an experience base and knowledge to be able to respond 
thoughtfully to the task. The staff identified the six members of the Advisory Board and ten 
other professionals to serve as respondents to this survey. 

The second decision concerned an appropriate format within which the respondents 
should make their selections. Several options were again considered, e.g., Q sort technique, 
Likert-type scale, and ranking along several dimensions. The issue was to ensure that this 
task would yield reliable results and minimize the effect of the particular method chosen. 
From those perspectives the simple ranking task was judged as best. A consideration 
regarding the reliability of this technique was that the individual rank was irrelevant. The 
important result was whether a given attribute was within the top ten of all attributes rated 
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since only ten attributes would be used. The staff judged that soliciting a listing of the top 
fifteen attributes would help focus the respondents' selection and increase the reliability of the 
selections. Thus, the 16 respondents were asked to identify the 15 most important program and 
staff attributes respectively. Again, the rationale for adding this survey was an expressed 
concern about the reliability of the first survey's results. The low response rate among 
directors of special education and in particular, superintendents of schools, led the staff to 
question their representativeness. With this survey a difference in methodology and 
respondents was considered as important for verifying the identified attributes. 

In the following sections, specific details of the methods, results, and findings are 
provided. 



M^faod 



Opinions from 16 professionals — professors, clinicians, school administrators and 
special education practitioners — with expertise in the field of special education were solicited 
in the Ranking Survey. The professionals were asked to rank order a list of attributes of 
exemplary special education programs and staff (see Appendix D for initial letter). The 
attributes were those identified from the responses to Parts I-A and II-A of the Elicitation 
Survey. The top 10 categories as ranked by the professionals were used in the subsequent 
Weighting and Implementation Surveys (surveys three through five) of the study. 

Subjects 

At a staff meeting on January 13, 1987, nominations were made for participants in the 
Ranking Survey. The staff decided that in addition to the six Advisory Board members, ten 
other professionals would be invited to complete the ranking survey. Staff members 
nominated those professionals with expertise in the field of special education whose research 
and publications were of such quality that there was a consensus that the nominee would 
contribute positively to the study. Accordingly, 16 were nominated for the ranking survey (see 
list in Appendix E), 

Materials 

The materials are described in terms of the two mailings sent out early in 1987 to the 16 
professionals. 

Advance letter. The initial correspondence consisted of an explanatory letter eliciting 
support and a stamped postcard. The professional was requested to return the postcard if s/he 
decided not to participate. This letter appears in Appendix D. 

Survey descriptioil. In the second mailing, which included the survey itself, the 
professionals were sent a cover letter, the survey with directions to rank the two sets of 
attributes (categorized from responses to the Elicitation Survey), a glossary of terms, and a 
postage-paid return envelope. The materials have been collated in Appendix F. 

The letter reiterated the rationale for the study and gave general directions, including a 
deadline for replies. The survey included specific instructions as well as a description of the 
process that led to the listing of 40 attributes of high school special education programs for 
students with mild to moderate handicaps and 23 attributes of high school special education 
staff. A blank space to the left of each attribute was provided, on which the respondent was to 



NHS Ranking Survey 8/13i92 



64 



Ox 



ERIC 



write a numerical value for that attribute, utilizing a range of 1 through 15. The value "1" 
designated the most important attribute, and "15" designated the least important. The 
professionals were requested to refrain from ranking two or more attributes equally, i.e., to 
avoid a tie. In this manner, the 15 most important attributes for each set were identifiable. The 
glossary consisted of examples for each attribute category. These examples were chosen from 
responses to the Elicitation Survey. The glossary was provided as a set of descriptors to aid the 
respondents in understanding the particular category's content. 

Survey Procedure 

This section relates the chronology of the survey, beginning with the survey document, 
its dissemination, the returns from respondents, and the data analyses performed on the 
resulting database. 

Survev mailing. Early in February, 1987, a letter was sent to the 16 nominated 
professionals, asking if their time constraints would permit their participation in the survey. 
A stariped, addressed postcard was enclosed. The respondent was asked to mail the postcard if 
s/he was unable or unwilling to do the survey. Non-return of the postcard meant that the 
individual would participate. 

The Ranking Survey packets were mailed on February 27, 1987. A thank you letter 
followed within two weeks. This thank-you letter also served as a reminder to those who had 
not yet completed their survey. 

S^ryey returns. All 16 of the ranking surveys mailed to professionals in the field were 
completed and returned in the mail. 

DMaiiQdin£. The professionals ranked the 15 most important attributes. Their 
numerical rankings were entered in a spreadsheet. Those attributes that the professionals did 
not rank (where the space provided was left blank) were given a value of "16." The 
professionals were requested to avoid giving the same rank to two or more attributes, and n-i 
ties occurred in individual responses. 

Data analysis. Two spreadsheets were created using AppleWorks software (1983), one 
for program attributes and another for staff attributes. Attributes were identified across the 
column headings, while the professionals' names made up the row labels. The professionals' 
responses (attribute rankings) were entered in the cells. Rankings were summed by column. 
The mean, standard deviation, and standard error of the mean were also calculated for each 
attribute category. Based on these sums and the means, the attributes were ranked. The 
attribute with the lowest total (137 for program attributes and 79 for staff attributes) was ranked 
first, since "1** was the value assigned to the "most important attribute'* and "15'* was assigned 
to "the least important " The remaining attributes followed in sequence based on their rank 
sums. 

When a tie occurred in the sums of ratings, the two attributes were awarded the same 
rank. However, the next number in sequence was skipped in assigning the rank of the next 
attribute. For example, among the program attributes, "Program support from staff, parents, 
business, and community" and "Regular education support and integration" had equal sum's 
of rankings (175) and therefore tied for seventh rank. The next attribute, "Successful 
independent living" with a rating-sum of 176, was ranked ninth. 

Column rankings were summed and the 10 attributes with the lowest totals (since "1" was 
the value for the most important attribute) were identified for use in the next stage of the 
research project, the Weighting and Implementation Surveys. 
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The spreadsheets generated with AppleWorks were edited into tabular form for ease of 
interpretation. These tables are presented and described in the following section of this survey 
report. 

Descriptive statistics — frequencies, means, and standard deviations — provide a useful 
view of the rankings of successful special education program attributes and special education 
teacher attributes, based on the 16 professionals' responses. 

Program Attrihutfis 

Table 12 shows the sum of ratings, highest assigned rank, mean of ratings, standard 
deviation, and standard error of the mean for the staff attributes as ranked by the 
professionals. 

Twelve of the 40 program attributes (33%) were given the highest ranking ("1") by at least 
one of the 16 respondents. These attributes, followed by the number (in parentheses) of 
professionals giving them the highest ranking were: "Individualized, appropriate "(1), 
"Community-based program" (1), "Vocational/career orientation" (1), "High school 
completion" (1), "Successful academic achievement" (1), "Employment success" (1), 
"Successful personal and social adjustment; self-concept/self-esteem'' (1), "Succe*:bful 
independent living" (1), "Effective staff (4), "Defined philosophy" (1), "Administrative 
leadership and support" (1), and "Comprehensive program" (2), Interestingly, each of these 12 
attributes received rankings ranging from "1" (most important) through "16" (unranked or 
least important). Moreover, all 40 attributes were excluded from a ranking in the top 15 
attributes by at least one professional. 

The greatest agreements were in those attributes receiving the lowest ratings, i.e., those 
attributes judged least important. Two of the 40 program attributes received the lowest rating, 
"16," from 15 of the 16 professionals. These two attributes, which were not included in the top 15 
by all but one of the professionals, were "Compliance standards," for which the one other 
rating was "15," and "Adequate community resources," for which the other rating was "10." 
Four attributes received rankings of "16" from 14 of the professionals: "Vocational 
assessment," for which the two other rankings were "8" and "9"; "lEP goals met "("4" and 
"13"), "Adequate physical plant" ("4" and "11"), and "Humanistic approach" ("11" and "13"). 

The mean values of the program attributes' ranks, as shown in Table 12, ranged from 
8.56 ("Effective staff," the highest-ranked ) to 15.94 ("Compliance standards," the lowest- 
ranked). The difference between the means of the first- and second-ranked attributes as well 
as the second- and third-ranked attributes was almost one integer; however, the difference 
between the third- and fourth-ranked attributes dropped to 0.06. 



ERIC 



J^mS Ranking Survey 8/10/92 



66 



<N 



P 

o 

C 

CO 



CO 
o 



t/) 

•4-3 

c 

CO 

CO 
•4-3 



CO 

o 

Ph 

C 

o 
'■+3 
CO 
o 
13 



O 

CO 

'o 
o 

CO 

-SI 



.2 
O 



0? ^ 



CO 



CO 



c 

CO 



T3 

bo CO C 
ffi CO »^ 



rS CO 

CO 1^ 



'C 



CO 

o 
u 



C 

CO 



00 



lO 00 
CO CO 



00 



t;- ^ ^ CO 00 00 

^ lf5 ,H lO CO 



CO <N O CO IC 

t> CO Tj< Tj< a> CO 
^ id id id id id 



a> 00 CO CO 

00 00 CO o 

id ' " 



IC <N O 
<D CO IC 

id ^ ^d id 



CO 

C 

C 

o 



to O IC fH CO 
IC IC CO «5 

o o o o 



00 
00 



00 as 



^ ^ o cr> o CO 1-1 

05 05 O rH lO «5 CO 
O O 1-H 1-H 1-H 1-H C4 



CO 



<N <N »-H »-H »-H 



<N 



CO S S 



o ^ 



J2 ^ 
t> t> o t> 



^ 

oo oo 



CO 



c 
o 



c 

.s 

o 
K< 

u 
CO 

CO 
C 
o 



o CO 
ct^ o 

w > 



o 
u 

CO 
^3 



CO y< 

cx c 

:£ -2 



c 
E 

E 



CO 

> 

CO 
u 

CO 



E 



CO 

C 

t 

CO 

C 
o 

CO 
I 

CO 

o 



c 

CO 
CO 



E 

<£ 

o 
p< 

CX 

CO 

E 

CO 



C 

.2 

If c 

CO O 

b) 6 

CO 

c8 .5 



6 

•4^ 

CO 



CO 



C 

E 

e 

o 

C 

CO 



o 

CX 
CL 

CO 

c 
o 

CO 
o 

:3 

0^ 
u 
CO 



^ CO 



O CO OO 



r-l (N CO 



♦ 



CO 



* 



c 

CD 

C 

a 

CD 



c2 

CO 
CO 

o 
o 



o 
o 

CO 

CO 
C 
o 

CO 

u 



to 

CO 

o 
:3 



c 
6 

CO 



C 

CO 

C 
o 



CO CO 



E 

CO 

& 

o 
K< 
a 

<o 
^> 

*co 
C 

K< 
CX 

E 

o 

o 



E 



CO 



r-1 (N CO 



§ 

s 



CO 



ERIC 



CO 



CO 



CO 



c 



nc3 
^ a> 

bX) CO c 
^2 CO 



CO 



CO u 



e 

CO 

s 

PL, 



c 

CO 



rH CO 00 

<N (N 



o 



<N rH 



O O 



a> o CO 

rH 05 05 

1-H d o o 



s g 



o a> CO 

05 00 

odd 



<N CO 
CO o 



O 05 05 00 
;0 05 xi< ,-1 

lO lO lO id ^' 



O CO 

C^^ l> CO l> 

CO CO CO CO 



rH 00 a> CO CO 

^ lO in 05 
CO CO <N 



o 
c4 



SCO lO 
CO 



^^OCOOiOirHOOCOO^lO 
'^'^WlOCOCOOOOOt-CrHCa 



c 

c 
8 



CO 



<N(NC^COCOCOCOCOCOCOCO 



rHC^rHi-lC^i-IC0C0C^COTf< 



xi< lo lo lo 



lO IC CO O 05 05 

53 5^ 5^ £^ 5^ ?3 



o 

CO 

o 
a 
c 
Q 



;3 



CO 

a 

o 

CO 
I 



e 

o 

CO 

CO 



C 

E 

> 

-S 

CO 



CO 



o 

CO 



CO 

O 

e ■ 

o 



c 
o 



CO CO 



CO 

c 
o 

CO 

a. 



00 



o 
o 

CO 

-& 



CO 

C 

S 
CO 



I 

O 

c 
o 

CO 

S 
a 

0} 
O 



c 

o 



CO 
o 

CO 

0) 
CO 

CO 



00 

o 



.Si 



CO 
> 



a 

CO 



2 S 



c 

e 

o 



e 

CO 
c> 
CO 

c 
o 

§ 



CO 

CO 
0) 



e 

00 

c _ 

E c 

a> rg 

CO 5 

CO 5 

o CO 



CO »x3 

E c 
co 



CQ 

•& 

OP 

CO 



c 
"S 

a 



•X3 



5 § 



CO 

CO 



5^ 



CO CO 



« S 5^5 85 ?J 



a> 

.5 

c 
o 
o 



cd 



0) 
CO 



CO 



c 

cd 



cd ^ 



CO »^ 



i 

o 

a. 



cd 



o 

00 

d d 



t*- 00 



O _ 

^ t> t> t> 



CO in 00 CD 

<£> CO CO O 



00 IC 
t-H 00 (N 
CO <N CO 



'^t-jOOOlO'^lOO^ 
<NCOC^CO<NFHrHd 



00 
CO 



t- 00 



o8 O O 

JO id id id id 



^ g g o 



CD ^ 00 



ID 



a> 
o 

c 
a> 

cr 

a> 

CO 

c 
cd 

a> 

(X 
o 
o 

CO 



o 



c 

<1> 

E 

a> 
'a 

e 

cd 
a> 

CO 
0) 

c 

(1> 

fc 

o 



6 

o 



CO 



E 

Cd 
o 
cd 



to 
cd 



o8 



cd 
cd 

B 

CO* 
CO 



cd 
cr 



(1> 
6 

*5 
cr 

(i> 



cd 
u 

*to 

-a 

cr 

(i> 



O 
I 

CO 

o 
O 



(i> 

E 



c 

0) 

E 

CO 
CO 
0) 
03 
CO 

cd 
Cd 

c 
o 

cd 
o 
o 

> 



CO 

o 

CO 
0) 

CO 

£ § 
S i 

8 



n3 
C 
cd 



.2 3 

C cd 
cd 

6 
K 



< 



0) 

o 

c 

cd 

o 
O 



^ 5o 83 



CO CO 



CD CD 

CO CO 



?8 ^ ^ 



While the sums of ratings and their means grew progressively larger, from 137 and 8.56 
("Effective stafT) to 255 and 15.94 ("Compliance standards"), indicating the sequence with 
which the professionals ranked the attributes, the standard deviations and the standard errors 
of the mean followed an opposite progression, from 6.73 and 1.68 ("Effective stafT) to 0.25 and 
0.06 ("Compliance standards"). This pattern indicated that the attributes with higher 
rankings had greater variances in their rankings. That is, less consensus was evidenced 
among the attributes judged most important. As mentioned above, if the professionals had a 
consensus^ it would appear to be in ranking "Compliance standards" as the least important 
special education program attribute, where 15 of the 16 respondents gave it the lowest rank 
("16"), and one respondent ranked it "15." This high agreement accounts for the attribute's 
almost-zero standard error of the mean. 

Of the top 10 program attributes, three attributes may be classified as program descriptors 
— "Effective staff;" "Individualized, appropriate programming;" and "Program support from 
staff, parents, business, and community." Two of the attributes had a curricular focus — 
"Vocational/career orientation" and "Post-secondary transition curriculum;" two refer to 
administration — "Administrative leadership and support" and "Regular education support 
and integration;" and three were outcome-oriented — "Employment success," "Successful 
independent living," and "Successful personal/social adjustment." Of the lowest 10 program 
attributes, four attributes were program descriptors — "Current research implementation;" 
"Adequate suppHes, materials, & equipment;" "Adequate physical plant;" and "Adequate 
community resources." Three had a curricular focus — "Basic academic skills curriculum," 
"Vocational assessment," and "humanistic approach." Two centered on the administrative 
aspect — "Cost-effective" and "Compliance standards;" and one centered on outcome — "lEP 
goals met." 

Table 13 shows the sum of ratings, highest assigned rank, mean of ratings, standard 
deviation, and standard error of the mean for the staff attributes as ranked by the 
professionals. 

Among the 23 staff attributes, 11 (48%) received the highest ranking ("1") from the 
respondents. These attributes, with the number (in parentheses) of professionals giving them 
a ranking of "1" were: "Instructional skills "(6), "Innovative instruction skills" (1), 
"Classroom organization skills" (1) "Works well with people" (2), "Background training and 
experience" (1), "Practices professional ethics" (1), "Philosophical position" (1), ^Teaches 
basic skills" (1), "Skill in assessing outcomes" (1), "Teaches survival skills" (1), and 
"Teaches personal-social skills" (1). However, these 11 staff attributes also received the lowest 
ranking ("16") from other respondents. Moreover, all 23 staff attributes were excluded from 
the top 15 attributes by at least one of the respondents. 

The staff attribute with a ranking most consistently low was "Personal characteristics," 
which was ranked sixteenth by 13 professionals. However, the ratings assigned to this 
attribute by the three other professionals were "2," "4," and "6." Eleven professionals gave 
"Tiaches basic skills" a ranking of "16"; however, five other professionals gave this attribute- 
ratings ranging from "1" through "11." 

The mean values of ratings for the attributes of quality special education teachers ranged 
from 4.94 ("Instructional skills") to 13.75 ("Personal characteristics"); however, the means of 
the two highest-ranked attributes ("Instructional skills" and "Assessment skills for planning 
and instruction") had a difference of more than three integers (4.94 and 8.06). The difference 
between the means of the second- and third-ranked attributes dropped to 0.07. 
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As v/ith the program attributes, the standard deviations and standard errors of the mean 
followed an opposite progression when compared to the attribute ratings* sums and means. 
While the latter grew progressively larger (133 and 4.94 for "Instructional Skills" to 220 and 
13.75 for "Personal characteristics"), the former progressively decreased (5.53 and 1.38 for 
"Instructional skills" to 4.89 and 1.22 for "Personal characteristics"). As the rankings 
diminished, the variance similarly lessened. Thirteen of the 16 respondents agreed that 
"Personal characteristics" was the least important of the teacher attributes. Interestingly, one 
of the professionals ranked this attribute as second in importance. 

Of the top 10 teacher attributes, four attributes had an instructional delivery focus — 
"Instructional skills," "Curriculum and instructional planning skills," "Behavior 
management skills," and "Classroom organization skills." Two of the attributes referred to 
assessment — "Assessment skills for planning and instruction," and "Skill in assessing 
outcomes;" two centered on content areas — "Knowledge of transition" and "Incorporates 
vocational/career education;" and two focused on the personal/social aspect — "Works well 
with people" and "Works cooperatively with staff and administration." 



Discussion 

In the sequential process of conducting the multi-attribute utility measurements, this 
Ranking Survey was the second step. The first step was the Elicitation Survey, in which 
desirable attributes of special education programs and special education teachers were 
identified, along with special education program activities and pre-service teacher training 
activities. The next requirement in the multiattribute utility measurement methodology was 
to identify a subset of the program and staff attributes fi-om the responses provided in the first 
survey. This subset was determined by experts in the field by means of Survey 2, the Ranking 
Survey, described in this section of the research report. 

This section of the report briefly reviews the current reform movement in regular as well 
as in special education; enumerates the survey limitations in sample size, return rate, and 
instrumentation; compares the findings of the Ranking Survey with the findings of the 
Elicitation Survey; and summarizes findings and conceptualizes implications for future 
research. 

hsu^ in Regular and Snecial Education Reform 

Until the recent past, education in the USA was fundamentally aimed at the "average" 
child, with those above and below average lar^^'ely left to fend for themselves. Attention was 
focused on the majority members of the student population in a laudable striving for an 
egalitarian and democratic educational system. Benign neglect of minority members at 
either end of the achievement scale was neither inevitable nor premeditated; it was an 
inadvertent result. When PL 94-142 (1975) enabled "handicapped individuals" to pursue a 
"free and appropriate education," virtually every school district had to undergo renovations in 
facilities as well as curricula to provide for the influx of "special students." 

However, comparative studies conducted in the last two decades have found consistently 
negative results for American students at every sector of the achievement curve. Whether 
comparing scores on the upper end, or the middle section, or the bottom end, American pupils 
scored significantly lower than these of other industrialized countries. The publication of "A 
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Nation at Risk^ by the National Commission on Excellence in Education (1983) breached the 
dam of rhetoric that focused on the need for more effective teaching and learning. 

The decade of the eighties has seen a reform movement in the nation's schools. 
However, the movement, in calling for excellence, has focused on the right half of the curve, 
the average and above average popxilation. To this end, Stainback and Stainback (1984) argue 
for the merger of special and regular education, especially with regard to students with mild to 
moderate handicaps. The results of the Ranking Survey provide an alternative perspective of 
important attributes of special education. Among the experts' top ten rankings are goals which 
are generally valued in the regular education program: "Employment success," "Successful 
independent living," and "Successful personal and social adjustment." While regular and 
special education may share common goals, the content of special education programs has a 
different emphasis. These goals in special education are likely to be specific rather than 
general for many of its students. In addition, special education is more likely to include two 
other goal areas — **Vocational and career orientation" and "Post-secondary transition 
curriculum." Neither of these curricular areas fit with the excellence movement, which has 
emphasized achievement of basic academic skills. However, both the goals and the curricular 
areas are compatible with perspectives on the important characteristics of the future society. 
Johnston and Packer (1987), Mithaug et al. (1987), and Reeves (1988) have presented a picture of 
future society in which on-the-job training will be increasingly prevalent, basic functional 
academic skills are needed for job entry, and social skills, particularly those skills common 
to employment settings, will be critical for success. Mastery of such domains are particularly 
important when one considers that the proportion of the jobs at the basic level will decrease, thus 
increasing the competition for such jobs among a growing segment of the low achievement 
population. 

The other five program attributes in the Icp ten are procedural or facilitative rather than 
content-oriented but are compatible with the five just described and the issues confronting 
youth in the job market and in independent living: "Effective staff," "Individualized, 
appropriate instruction," "Program support from staff, parents, business, and community," 
"Administrative leadership and support," and "Regular education support and integration." 
Collectively, the program attributes provide an ideal model of special education 
programming. 

The introduction section of this phase of the project outlined two reform issues in special 
education: the regular education initiative (Reynolds et al., 1987; Stainback & Stainback, 
1984) and the transition movement (Will, 1984). Of the two reform issues, the descriptions of 
program attributes would seemingly be closer aligned to transition movement. The favored 
outcomes and curricular areas are not closely linked to regular education's priorities. In 
these two areas, tlien, the respondents' points of view provide interesting perspectives. Also of 
interest in light of the transition movement issues is that other curricular areas were not 
ranked higher by the respondents, e.g., "Life skills curriculum" ( ranked 13), "Community- 
based program" (16), "Personal social skills curriculum" (18), "Competency based approach," 
and "Functional academics" (23). Given the respondents' identified goals for special 
education programs, these program attributes would likely have relevance. 

The respondents' rankings also are at odds with the dominant issues in the regular 
education reforms. While the regular education reforms have an assumption that post- 
secondary education is desirable and should be a goal, the goals highlighted in thif survey 
were not compatible. These differences in goals and content emphasis must be understood in 
the context of implications for the handicapped population - their access to quality education 
and post-secondary employment and educational opportunities. Such differences are 
important as reforms, curricula, and evaluations are examined. 
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Secondary Level Pre-service Training 

The respondents also provided perspectives on the desired qualities of the teaching staff. 
In this section, the respondents' priorities will be compared and contrasted with those priorities 
evidenced and described in the literature. The clear consensus is that teachers should first of 
all demonstrate good instructional skills. The first three attribute rankings focus on the 
teacher as an instructor: ''Instructional skills," ''Assessment skills for planning and 
instruction "Curriculum and instructional planning skills." Such a ranking may not be 
too surprising, given the other attributes or the traditional concepts of teaching. However, the 
ranking is disparate with the emphasis in special education teacher training programs 
(C. Clark, 1988; Schulman, 1986; Warren, J 985). The training programs, with their 
traditional ties to the college or university environment, have emphasized delivering content 
knowledge over the procedural and strategic knowledge which guides teachers' classroom 
decision making. 

Certainly, the content knowledge has been easier to deliver for a number of reasons and 
fits with the other liberal arts and sciences' degree programs in the same settings. Similarly, 
the changing characteristics of the "special education teacher in training" (McLaughlin et al., 
1988) would also fit more easily with the training program that emphasizes content knowledge 
rather than pedagogical knowledge. Those important characteristics are that the student is 
al so a professional teacher with current employment who might be assumed to already have the 
necessary pedagogical skills in instruction, curriculum and instructional planning, 
behavior management, a:id classroom organization. 

In the context of examining the robustness of the Ranking Survey's results, two studies 
seem particularly relevant: Bursuck and Epstein (1986), and Weisenstein (1986). The 
frequency with which similar priorities are listed provides interesting comparisons. Figure 1 
lists the findings from this study and those three studies cited above. A common denominator 
across the studies is the emphasis on instructional, classroom management, assessment, and 
people skills — skills for working successfully with students, parents, and professional 
colleagues. Seemingly, the majority of the knowledge areas are trainable, that is, the pre- 
service programs could provide instructional experiences. However, the social interaction 
skills seem to emphasize skills which are trait characteristics. As such, these traits seem less 
likely impacted by a college course or program. Noticeably absent in the list v/ere specific 
content knowledge areas. The closest Bursuck and Epstein offer for content knowledge is 
literacy in computer skills, though their list includes reference to a specific pedagogy for 
euucating adolescents. Weisenstein's listing recommends coursework in teaching 
techniques and instructional materials in personal-social skills, daily living skills, 
occupational guidance as well as academic areas. These domains are framed in a context that 
addresses the need for transition planning. 

Comparisons of these data with teacher certification requirements would likely provide 
other notable contrasts. As McLaughlin et al. (1988) illustrated, a gap exists in the states' 
requirements for teachers and the emphasis desired by pre-service trainers and district level 
administrators. Given these differences, the state departments' observed lack of quality 
among new teacher candidates might be expected; a shared consensus on quality is lacking. 
Interestingly enough, the survey data gathered here does show high agreement with the recent 
researchers' findings. 



NHS Ranking Survey 10/19/92 



75 



E 



CO 
CO 

(J) 



C 



CO 

c 
o 

1 



3 <oi2 

o w ra 

CO ^ 3 



crc i2 



CT3 



iii 

to CO a 
CO o 
Q> CO CO 



c 
o 



CO 

CO 
> 

CO 

c 
c 

CO 

gL 
E 
2 

? 

Q. 



AS 
T5 

c/j CO 

c ^ 
^ c 

O Q) 

Si 8 
^« 

c a. c 
S 9 ^ 

w CO CO 
CO 



0) 
CO 



c »- 

^ CO 

0) Q C 

CO O 



CO • 

'5 . 



^1 
? " = 

« g 2 

CO ^ Q 

o 
O 



Q. C « 
•Jr.O? CO 

S - J? ^ 



O 



CO 
3 T3 



_co 

1 

c 
o 

CO 

3 

CO 
> 

0) 
■D 

c 
CO 

? 

c 
c 

JO 
Q. 

E 
2 



C 

^ S ^ 

CO 



CO 



CO "O 

C3 0) c 

CJ) o CO 

^ O cn <^ 
^ s c ^ 

liil 

O O O 



0) 



CO 

3 
CO 

8? 



CD 

CO 

CO 

> 

o to 

is 

« c/> 

c ^ 
Q) — 

E ™ 

c "to 

'co 

Q 



c 

.2 
^-^ 
CO 

CO - 



c 
o 
•c 
a> 

•c 



E-- 



CO 



c 
CO 

c 
a> 

E 



S gL 
^5 



CD O ^ 

E 2lu 

CO 

Z) 



03 o 

a> CO 

Q> O 

CO ■'S 

S£ 3 

3 

O 

^ C 

2~ 

c c 

o 

X 
a> 

CO 

ID 



> 
c 

CO 

Q> CO 

is 

- o 

CO 

O 0) 

a> o 
0) CO 

5 Q) 



CO 

■2 ^ 
« I 

c CO 

0) 2 
o. o 

^« 

a> 
O 



CO 

(1) o 

w 
UJ 



x:? 
o CO 
!c CO 

^§ 
lii- 

_ c CO 
CO o c: 
goo 

CO .> ~ 
CO 0) 

Hi 

3 

III 

c 
LU 



o 

CO 



0) 



Q. CO 

ES 

O 0) 

2.E 

:= CO 



a> 

I 

■D 

c 
a> 
E 
E 

§ 



2 

3 

IZ 



CO 

"co 
c 
o 



CO 



i 

Q. 



il 

0) .t: 

CO 

< 



c CO 

CO N 
CO 

CO P) 

2 2 

CO CO 

•E 

CO ^ 
E «^ 

^ JO JO 

3 s ^ 

•C CO CO 
3 

o 



c 
.9 

*co 
c 

2 
o 

8 



CO 



CO 



a> 

O) 
CO 

CO 

E 
o 

o 

CD 



Q. 
O 

x: 



0) 
CO 

I 



o 

c^ 

3 

o 

O) 

E 
*co 

CO 
O) 
CO 
CO 

CO 



O 

o 

3 
•D 

Q> 

0) 
CO 

o 
> 

CO 
Q) 

"co 



8 

c 



i 
s 

I 

1 

CO 



ERIC 



While some educational leaders have advocated for closer integration among special 
education and regular education, the curricular emphasis from this survey suggests 
otherwise. While Pugach (1987) and the Holmes group (1988) have argued in favor of a closer 
alignment in training programs, the results from this survey suggest such a restructuring 
would be ill advised. These data do emphasize a view that high school special education 
students have different needs than regular education mainstream students — differences in 
both curricular emphasis and instructional techniques. The logic of impacting the education 
system through teacher training programs is quite good, but such a change is not supported 
through the observations from this survey. 

Comparison with Survey 1 (Elicitation Survev) Findings 

The Elicitation Survey, discussed in the preceding section of this report, was a 
prerequisite to the Ranking Survey, the second phase of the research project. While the 
Elicitation Survey's results were nominally categorized into special education program and 
staff attributes, as well as activities included in special education programs and pre-service 
teacher training, the identified attributes and activities were not ranked on a scale. Thus, the 
second survey was chosen as a means of identifying the more important program and teacher 
attributes. Of interest in this discussion is a comparison of the Ranking Survey's results with 
the frequency counts in the DOSE, SOS, and PTTs' responses in "Survey 1: Elicitation Survey 
to Directors of Special Education, School Superintendents, and Teacher Trainers." 

Program attributes. In ranking the program attributes, the professionals who responded 
to this survey when compared with the DOSE, SOS, and PTT who responded to the first survey 
agreed more than they disagreed. Six of the top 10 program attributes, as ranked by the DOSE 
and SOS, also were identified among the top ten rankings of this second survey's respondents. 
Table 14 gives a comparative listing of the top ten program attributes as ranked by this survey's 
respondents, and as enumerated by the DOSE, SOS, and PTT. The professionals were chosen 
as the reference group, since Survey 2 focuses on the professionals' responses. Therefore, the 
professionals' rankings are given first, followed by columns for the DOSE, SOS, and PTT. 
The reader may want to compare Table 14 with Table 8 in the Elicitation Survey. 

The six attributes that were similarly ranked among the first 10 by the DOSE as well as 
by the professionals., (see Table 14) were "Effective staff;" 'Vocational/career orientation;" 
"Individualized, appropriate instruction;" "Employment success;" "Program support from 
staff, parents, business, and community;" and "Regular education support and integration." 
The four attributes ranked highly by the professionals but not by the DOSE were 
"Administrative leadership and support," "Post-secondary transition curriculum," 
"Successful independent living," and "Successful personal/social adjustment." 

With the SOS, the professionals similarly ranked the following six program attributes 
among the most important 10: "Vocational/career orientation;" "Individualized, appropriate 
instruction;" "Program support from staff, parents, business, and community;" "Regular 
education support and integration;" "Successful independent living;" and "Successful 
personal/social adjustment." The four attributes ranked highly by the professionals but not by 
the SOS were "Effective staff," "Employment success," ^'Admini strati ve leadership and 
support," and "Post-secondaiy transition curriculum." 
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Table 14 

Attributes of Hich School Snftdal RHnrfltinn Prft^awfi for Stuflftnts with Mild to Modftratft 
Handicaps as Ranked bv Professionals. DOSE, ROR, PJT 



Program attribute 



Ranking by 



Professionals 



DOSE 



SOS 



PTT 



Effective staff 

Vocational/career orientation 
Individualized, appropriate 
Employment success 
Administrative leadership & support 
Post-secondary transition curriculum 
Program support from staff, parents, 

business, and community 
Regular education support & integration 
Successful independent living 
Successful personal/social adjustment 



1 
2 
3 
4 
5 
6 

7* 
7* 
9 
10 



6 
3 
1 

9* 
30* 
13* 

4 

2 
13* 
11* 



24* 
3* 
2 

19* 
24* 
24* 

3* 
1 

10* 
8* 



18* 
1 
2 

7 
29* 
U 

6 

4 
14* 
18* 



'ERIC 



lifilfi. * indicates a tie. DOSE = Directors of Special Education, 

SOS = Superintendents of Schools. PTT = Pre-service Teacher Trainers. 
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The PTT and the professionals agreed on half (five) of the 10 program attributes that they 
ranked most highly. These attributes were *Vocational/career orientation;" "Individualized, 
appropriate instruction;" "Employment success;" "Program support from staff, parents, 
business, and community;" "and Regular education support and integration." The other five 
program attributes ranked highly by the professionals but not by the PTT were "Effective 
staff," "Administrative leadership and support," "Post-secondary transition curriculum," 
"Successful independent living," and "Successful personal/social adjustment," 

Staff attributes . Table 15 conveys a similar perspective for the top-ten staff attributes as 
Table 14 does for the top- ten special education program attributes. The reader may want to 
compare Table 15 with Table 10 in the Elicitation Survey. Among the staff attributes (see 
Table 15), an increase in rate of agreement occurred among the group respondents. Seven of 
the staff attributes ranked among the top 10 by the professionals also appeared among the top- 
ten rankings of the DOSE, as compared to six among the program attributes. These staff 
attributes were "Instructional skills," "Assessment skills for planning and instruction," 
"Curriculum and instructional planning skills," "Behavior management skills," "Works 
well with people," "Classroom organization skills," and **Works cooperatively with staff and 
administration." 

Likewise, the SOS and the professionals had a higher rate of agreement in ranking the 
staff attributes than in ranking the program attributes. Seven of the staff attributes ranked 
highly by the professionals were also ranked among the top 10 by the SOS: "Instructional 
skills," "Assessment skills for planning and instruction," "Curriculum and instructional 
planning skills," "Behavior management skills," *Works well with people," "Classroom 
organization skills," and "Works cooperatively with staff and administration." Staff 
attributes ranked highly by the professionals l)ut not by the SOS were "Knowledge of 
transition," "Skill in assessing outcomes," and "Incorporates vocational/career education." 

Finally, the PTT and the professionals also had a higher rate of agreement in ranking 
the staff attributes than in ranking the program attributes. Six of the staff attributes ranked 
highly by the professionals were also ranked among the top 10 by the PTT: "Instructional 
skills," "Assessment skills for planning and instruction," "Curriculum and instructional 
planning skills," "Behavior management skills," "Works well with people," and "Works 
cooperatively with staff and administration." As with the program attributes, a remarkable 
level of consistency is noted among different respondents and at different intervals. 
However, two other points are quite problematic and, depending on ore's philosophy, quite 
divergent. One difficult point includes determining the relative emphasis given the desired 
attributes. Which of the attributes are more important to a quality program? This point is 
resolved at the state level with the teacher certification requirements. The second issue then 
becomes one of how to best deliver a training program which would maximize the proficiency 
level of the teachers and determine the responsibilities that should be shared among local, 
state, college or university, and federal levels. Subsequent activities in this project help to 
address these issues. 
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Table 15 

Attributes ^QuaIifa^Sne^dal Education Teachers for High School Students with Mild fcn 
Moderate Handicaps^ &s Ranked bv Professionals, DOSE . SQS. and PTT 



Staff attribute Ranking by 





Professionals 


DOSE 


SOS 


PTT 


Instructional skills 


1 


5* 


1* 


1 


Assessment skills for planning & 










instruction 


2 


8* 


8 


5 


Curriculum and instructional 










planning skills 


3 


7 


5* 


7 


Knowledge of transition 


4 


16 


14* 




Behavior management skills 


6* 


10 


9 


6 


Works well with people 


5* 


3 


4 


3* 


Classroom organization skills 


7 


5* 


5* 


12 


Works cooperatively with staff & 










administration 


8 


4 


7 


8 


Skill in assessing outcomes 


9 


17* 


14* 


17* 


Incorporates voc/career education 


10 


17* 


14* 


11 



Niiti^. * indicates a tie. DOSE = Directors of Special Education. 

SOS = Superintendents of Schools. PTT = Pre-^service Teacher Trainers. 



NHS Ranking Survey 10/19/92 



80 



ERIC 



; qf the Study 

The survey instrument employed in the Ranking Survey was drafted and edited by the 
principal investigators of this research project, after due review of relevant literature. The 
instrument was pilot tested among the research staff members associated with the grant. 
Although all of the requested respondents provided usable data, the sample size would impede 
researchers from inferring generalizations beyond their intended scope in this project. The 
comparisons to the frequency counts of the nominal categories from the first survey, the 
Elicitation Survey, do suggest congruence in judgments and thus bolster confidence in use of 
the data. However, in a retrospective consideration, perhaps the second survey could have been 
considered as a cross validation activity. From that perspective the ten most frequently 
occurring program and staff attributes would have been used in subsequent project activities 
and this second survey's results would have been considered as data supporting such a choice. 
On the other hand, the very low response rate from the first suivey was what prompted the 
change in the proposal plan resulting in the inclusion of this Ranking Survey. 

Summary and Conclusions 

Opinions of 16 professionals — professors, clinicians, school administrators and special 
education practitioners — with expertise in the field of special education were solicited in this 
phase of the research project, the Ranking Survey. These professionals were asked to rank 
order attributes of exemplary special education programs and staff. The attributes were those 
attributes identified from the responses to Parts I-A and II-A of the Elicitation Survey, 

Afler responses to the Ranking Survey were tabulated, statistical analyses disclosed that 
the attributes of special education programs for high school students with mild to moderate 
handicaps (see Table 12) which received the 10 highest rankings were: "Effective staff;" 
^'Vocational/career orientation;" "Individualized, appropriate program;" "Employment 
success;' "Administrative leadership and support;" "Post-secondary transition curriculum;" 
"Program support from staff, parents, business, and community;" "Regular education support 
and integration," "Successful independent living;" and "Successful personal/social 
adjustment." 

The special education staff attributes (see Table 13) that received the 10 highest rankings 
were: "Instructional skills;" "Assessment skills for planning and instruction;" 
"Curriculum and instructional planning skills;" "Knowledge of transition;" "Behavior 
management skills;" "Works well with people;" "Classroom organization skills;" "Works 
cooperatively with staff and administration;" "Skill in assessing outcomes;" and 
"Incorporates vocational/career education," 

The results of the rankings were reviewed in light of recent recommendations for 
reform in teacher education programs and recommended priorities. The survey results were 
interpreted as not supporting the greater integration of regular and special education as 
advocated in the regular education initiative (Reynolds, Wang, & Walberg, 1987; Pugach, 
1987). In addition, the robustness of the findings were evaluated through comparisons with 
responses from the first survey. Overall, the four groups thus far involved in the survey 
agreed more than they disagreed regarding the attributes of quality special education 
programs and staff members for high school students with mild to moderate handicaps. The 
results in Table 14, for example, indicate that the professionals, the DOSE, the SOS. and the 
PTT agreed on at least half (5) of the top 10 attributes of quality high school special education 
programs. The professionals, the DOSE, and the SOS agreed on more than half (6) of the top ten 
program attributes. 
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Regarding the staff attributes, the four groups again agreed more than they disagreed. 
As indicated in Table 15, the professionals and the PTT agreed on more than half (6) of the top 
10 attributes of successful special education teachers for high school students with mild to 
moderate handicaps. Among the professionals, the DOSE, and the SOS, the rate of agreement 
was even higher ~ 7 out of 10. 

The degree of concordance suggests that all groups were using similar criteria in 
forming their judgments and that the results of the Ranking Survey have stability and 
generalization across these groups who are so closely involved in special education programs. 
The subsequent project activities were designed to establish priorities among these program 
and staff attributes and determine the activities which would maximize these attributes as 
outcomes of a high school special education prograun or a teacher training program. These 
steps of the project are described in surveys tihree through five. 
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National Study 
of High School 
Programs for 
Handicapped 
Youth 



Gari/ M. Clark 
Prina}ml I tnrH' t i^iU.^ » 
(913) $64-495*4 

Don Dorscy 
Research Cooriiiunter 
(9Ui S(^4'47iiO 
(91.^) S64'49!i4 

H. Carle Ktwwiton 
(91.^ t S64-49?4 

Darifl r. \UUard 
R e>ea rch A .-m \ :tUi 
(91 ^' S64-4''$u 



Joanne R. Boiiner 
(91}. $1-^4-49:^4 



February 20,1987 

&NAME& 

&OFFICE/0& 

&ADDRESS1/0& 

&ADDRESS2/0& 

&CITY&, &STATE& &ZIP& 

Dear &GREET&: 

As you are possibly aware, we are involved in a variety of research projects, one of 
which is the National Study of High School Programs for Handicapped Youth, For 
those of you unfamiliar with our project, we have enclosed a copy of the abstract to 
give you some ideas about the project's work scope. Our purpose in writing is to 
request your assistance with one phase of the project, ranking two sets of attributes. 

More specifically, the two sets of attributes we are asking you to rank concern 
secondary level special education programs. The first set of attributes describes 
exemplary high school special education programs. The second set describes 
attributes of exemplary special education staff. Some of you may feel unfamiliar 
with this subject area, i.e,, seondary level special education programs and staff; 
however, we believe that your views are important to consider. 

Some of you may wonder how we came to select you. Quite simply, we considered 
the professionals who we know personally or whose work we value, and narrowed 
the list to 17 names. You are one of the 17 "lucky" folks who we believe can 
meaningfully contribute to our data. Remember you are not part of a random 
sample! 

If you are willing to assist us, we ask you to do two things right now. First, reserve 
about fifteen minutes of your time for completing this task between the 3rd and the 
5th of March. The second thing is to accept the postcard as a colorful reminder of 
your friends at the University of Kansas, and of our forthcoming survey. We also 
enclosed the postcard just in case someone is unable to respond to the survey within 
our timeframe or chooses instead to feel riddled with guilt for the next twenty years. 
If you choose not to participate, mail us our postcard. If we don't receive your 
postcard, you can anticipate receiving our survey. 

Thank you for assisting us, and we will be happy to return the favor. 

Sincerely, 



Gary M. Clark 



Daryl F. Mellard 



Don Dorsey 



The University of Kansas 
Department of 
Special Education 
377 Haworth Hall 
Lawrence, KS 66045-2330 
. (913) 864-4954 
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Dr. Stanley L. Deno 

Special Education Department 

University of Minnesota 

233 Burton Hall 

Minneapolis, MN 55455 

(612)624-7090 

Dr. Deno 

Dr. Norman Gysbers 

Dept. of Counseling & Personnel Services 

University of Missouri 

417 South 5th Street 

Columbia, MO 65211 

Norm 

Dr. Don D. Deshler 
Director, IRLD 
University of Kansas 
223 Carruth-O'Leary 
Lawrence, KS 66045 
(913)864-4780 
Don 

Dr. Andrew Halpern 

Special Education Department 

University of Oregon 

211 Clinica? Services 

Eugene, OR 92403 

(503)686-3585 

Andy 

Dr. Susan Brody Hasazi 
Special Education Department 
University of Vermont 
405 Waterman Building 
Burlington, VT 05405 
(802)656-2936 
Susan 

Dr. Robert Gaylord-Ross 
Special Education Department 
San Francisco State University 
1600 Hollo way Avenue 
San Francisco, CA 94132 
Robert 



Dr. Earle Knowlton 

Special Education Department 

University of Kansas 

377 Haworth Hall 

Lawrence, KS 66045 

(913)864-4954 

Earle 

Merry ivlaitre 

Mason City School District 

1515 South Pennsylvania Avenue 

Mason City, IQ 50401 

Merry 

Dr. Mary Jane Pearson 
CSU Sacramento 
School of Education 
eOOOJStreet 
Sacramento, CA 95815 
<916)485-7908 
Mary Jane 

Ed Regan 

Director of Special Education 
Shawnee Mission USD #512 
7235 Antioch 

Shawnee Mission, KS 66204 
Ed 

Dr. Maynard Reynolds 
Special Education Department 
University of Minnesota 
233 Burton Hall 
Minneapolis, MN 55455 
(612)624-7090 
Maynard 

Dr. Stuart Schwartz 
Special Education Department 
University of Florida 
LOE 

Gainesville, FL 32611 
Stuart 

Dr. Patricia Sitlington 
Dept. of Public Instruction 
Special Education Division 
Grimes State Office Buildmg 
Des Moines, lA 50319 
Pat 
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Dr. Judy Smith-Davis 

Research & Education Planning Center 

College of Education 

University of Nevada 

Reno, NV 89557 

(702)784^921 

Judy 



Dr. Alice Vetter Zemitzsch 
Highland Park High School 
433 Vine Avenue 
Highland Park, IL 60035 
Alice 

Dr. Naomi Zigmond 
University of Pittsburgh 
726 LRDC Building 
3939 O'Hara Street 
Pittsburgh, PA 15260 
(412)624^960 
Naomi 
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SURVEY TO SELECTED EXPERTS 

Background 

We asked directors of special education, school superinten- 
dents, and special education teacher trainers to list P^''^"^^" 

(a) the important attributes of high school level soecial 
educatxon programs for students with miA to moderate handicaps 

h.-oh desired attributes for special education teachers in 

Ilandic'aps" Programs for students with mild to moderate 

extenI?ve7i?^°o'5:'"'' '° °V initial survey provided us with an 
!nH^ / J program descriptors. This listing was analyzed 

till h'''°J^^'^ program attributes from which you 

ti'es of I r H° ''"^ 'i^; Likewise, the desired quali- 

^i^ff \! teaching staff were analyzed and categorized into 23 

top 15 Bat'r'' "'t'^' t° -nk the 

ll W-^'i K ""l^^"8s of the most important attributes, 

of \ ^"bsequently evaluate the extent to which the activities 

of HS special education programs or teacher preservice proerams 
contribute to these attributes. '•ervice programs 

The rankings you assign to the attributes might be thought 
of as addressing the question: What are the fifteen areas which 
one should evaluate to judge the efficacy of high school leHl 

hand'i? ^or students with mild to moderate 

handicaps? Likewise, for teachers one might ask- What \,rV rll 
fxfteen attributes on which to judge special education teachers? 

r«ni,s!''^°'' ^° giving you the specific directions to complete the 
rankings, please review four points. t-ompxeLe tne 

attriiutel'' directions are the sa.e for each grouping of 

2) We have provided a glossary which includes descriptors 

meanin"/o°f the' J ^ ' ^ * . ''^"'"^ f a mi 1 i a r i t h o ^r 

attrAur.^ attributes by studying the descriptors. The 

attributes are arranged in the glossary according to the number 
in parentheses which follows the attribute. number 

3) Please return the survey by March 5, 1987. 
A) Call us collect if you have any questions. 



IHE2 xprtsrv 02-27-87 

'£rIc I ; 



Directions 

-.isn of attributes is arranged in 3 randomized 
order^ These attributes concern hign scnooi level special eauca- 
tion programs. In the space to the left of the attribute, record 
a numerical value in a range from 1 through 15. The value 1 
designates the most important attribute. The value 15 designates 
the least important attribute. We would prefer that you avoid 
using the same ranking value twice, i.e., avoid tie ranks. 

Part I-A Program Attributes 

Successful personal and social adjustment (16) 

Functional academics (38) 

Student-teacher ratio (23) 

Comprehensive program (39) 

Counseling and guidance (4) 

. Vocational/career orientation (12) 

^ Successful independent living (17) 

Cost effective (22) 

Age-appropriate curriculum (35) 

Study skills/Learning strategies (37) 

Competency based approach (32) 

Effective staff (24) 

Personal, social skills curriculum (34) 

Program support from staff, parents, business, and 

community ( 27 ) 

. High school completion (13) 

Basic academic skills curriculum (7) 

Adequate supplies, materials, and equipment (30) 

Life skills curriculum (8) 

Defined philosophy (33) 

Multi-disciplinary approach (2"^ 

Studentsatisf act ion (18) 

Curriculum scope and seque^v. . 5) 

Administrative leadership aiia support (36) 

Employment success (15) 

. Vocational assessment (5) 

lEP goals met (19) 

Individualized, appropriate (1) 

Humanistic approach (31) 

Current research implementation (10) 

Monitoring and assessment system (25) 

Regular education support and integration (3) 

Case management system (20) 

Post-secondary transition curriculum (9) 

Adequate community resources (29) 

Adequate physical plant (28) 

Successful academic achievement (14) 

Validated instructional methods (40) 

Community-based program (11) 

Compliance standards (21) 

Promotes professional growth (26) 
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Directions 



'he following list of attribu' 



IS 15 in a randomizea order 



^-ese attributes concern high scnool level soecia -auca— -.n 
reacners the space to the left of the a 1 1 r iVu t e , r e c o Td a 

n^t;i\'h '^^r.''' ^ "^^^ ^^^"^ ^ through 15. The value 1 desig! 
nates the most important attribute. The value 15 designates the 
least important attribute. We would prefer that you avoid usinj 
the same ranking value twice, i.e., avoid tie ranks. ^ 

Part II-A Staff Attributes 



Pursues professional development (13) 
Behavior management skills (7) 

Works cooperatively with staff and administration 
Instructional skills (2) 

Teaches study skills; Learning strategies (18) 
Time management skills (6) 
Knowledge of transition (4) 

Assessment skills for planning & instruction (15) 
Classroom organization skills (5) 
Teaches basic skills (19) 

Incorporates vocational/career education (22) 

Curriculum and instructional planning skills (1) 

Consultation skills (10) 

Innovative instruction skills (3) 

Skill in assessing outcomes (20) 

Counseling skills (16) 

Works well with people (9) 

Practices professional ethics (12) 

Personal characteristics (14) 

Background training and experience (11) 

Philosophical position (17) 

Teaches survival skills (21) 

Teaches personal-social skills (23) 



(8) 
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GLOSSARY 

t_ 1 5r witr Eh amo I es 



I-H. Program Attributes 

AD^ivi^dual^izeda^ £Sfi}22S12iSis 
personalized 

focus on ind i vidual needs 
rnult i modal instruct ion 
flex ibi 1 ity 

dir^itizdisciel i^nary gofiCQ^Sb 
mult i— sourced 
trans-d isci pi inary 
use of multi-disciplinary 
team 

BSSir^i^I! §^M£^ti.2Q suggort and 

iDt^3i2§ti^on 
EMH/TMH are integrated as 

possible 
var i et y of ma i nst ream i ng 

opport unit ies 
nvolved in total school 
social ly integrat ing 
least restrictive environment 
regular classroom teachers' 

involvement 
Q9MQ§^lina guidance 
beg i nn i ng career counse ling 
counseling services provide 

support & guidance 
^9e^ti2Q§i assessment 
9th graders take DftT 
vocational evaluation thru 

local agencies 
QMIiniejiiiiiim scoge and sequence 
curricul um content 
Is curriculum sequenced and 

broad? 
curriculum development , 

flexibility 

^£§derni^c ski^l^l^s curri_- 

cul_urn 

basic skills of reading, 

math, writ ing, speaking 
basic ski 1 1 development 
provides academic growth 
kif § skii^s curni^culum 
provide social & independent 

1 i ving ski lis 
1 i f e cent ered for pr act i ca 1 

experience 
reflective of life needs 
daily living skills 



^« E2st -secgndarv transition 

transit ional act ivi t ies 
preparation of student for 

future /trans it ion prog 
p 1 arm ing for post -HS 
prepares st udent to t ake 

advantage of available 

public agencies 
vocat ional /trans it ion 

planning 
QiiilZIieDt Iiesearch imoiernent- 

ati^on 
general i zat i on/ 

ma i nt enance t ra i n i n g 
up— t o-dat e t echniques & 

materials 
innovat i ve 
11. Q2[Q[0!:i!2ity— based BCogram 
commun ity or i ent ed 
put students in community 

for job training 
community— based as well 

as school -based 
^2e^ti,onai/ career or i ent at i 
vocat ional /transit ion 

planning 
voc ed has 3-year rotation 

program for EMH 
work study 

appropriate work study/ 
vocat ional programs 
13. HiSb school. £2£13Bl.et ion 

holding power, i.e., drop 

out proport ion 
graduat ion 

meet req u i r ement s for HS 

diploma 
percentage of students who 

graduate 
cont inue in school 
geared toward graduation 
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15, 



16. 



17. 



la. 



19 



Successful, acagerni^c achi.evB- £0- 

nign Der^cenxage Dashing 

sTare comDerency resr 
t:©st scores uoon graduation 
stuaent achievement 
quality of student growth 

& program monitoring 

sy st ern 

students making gains on 

test scores 
pre/ post score compar i sons £ 1 . 

success in high school 

st udents in job sit uat ion 

after school 
successf u 1 pi acement of 

students after HS 
are students productive 

cit i zens (employment ) ? 
successful employment 
vocat i ona 1 pi acement s 
Slr^ee^l^f ul^ e®12sonal^ and 

social^ adjustment 
student self -esteem 
c 1 assroom beh av i or 
student conduct 
bet t er se 1 f - i ma g es 
Suee§ssf ul, independent li.vi.n3 
students able to locate 

employment or advanced 

training 
student success after 

graduat ion 
succcess in terms of post— 

secondary experiences of 

graduate 
functioning in society 
?t]=id§Dt satisfaction 
st udent part of deci s i on- 

making process 
positive student attitude 

toward services received 
h i gh attendance 
feedback — comments from 

parent s/st udents/staf f 
liE aSSis m3t 
student progress/ 

per f ormariee (I EP ) 
pupi 1 progress/complet ion 

of appropriate goals 
number of students who meet 

goals/object ives 



£3. 



£4. 



*=;^§e [oanaaeiTienr svsrem 
perinea goais & ODjeccives 
clear, concise yearlv vv 

-ong— range goals 
follow uD comole-cers 
wel 1 defined pol icies & 

procedures for placement 
efficient /not excessive 

paperwork 
records of success of students 

who have completed program 
QstQBii^riee standards 
confidentiality of student 

files' 
non-biased/ 

nond i scrim inatory 
appropriate percentage of 

minority enrol Iment 
Does it meet compliance 

requirement s? 
nat i ve language 
Qsst— effect ive 
Student -teacher ratio 
size of classes 
I2I5 or less teacher/pupil 

rat io 
Effective staff 
teacher select ion 
staff trained adequately 
t eacher pe'rforuiariCG 
teachers have knowledge 
MoQitoriDs and assessment 

sy;stem 
appropriate, t imely 

d iagnosis & assessment 
provides cont inuous 

assessment 
rel iable test ing of 

st udents iri program 
d iagnosis /screen ing 
group 8c individual test 

scores . 
all lath graders take 

compet ency t est 
data based 

follow-up of graduates 
Promotes ECSf gSSional ai22wth 
staff development component 

for teachers & staff 
on-going in-service training 

for staff & parents 
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23. 



30. 



31. 



34. 



commuri i^t y 
sTaff ernoa-cny 
crommun i r y awar^eness 
inpur by oar^ents 
regular ed staff feels SPED 

program working 
open cornmunicat ion with staff 

& parents 
9^§9!:i§tS Obil^ical. Biant 
facilities to meet 

students' needs 
appropriateness of site 
acceptable physical 

environment 
env i r onment a 1 eq u i va 1 ency 

to regular education 
funded appropriately 
Bd^Slzilt^ e2[QD3k^Dity !2M^2J:i!2£M5 
adequate resources 
Q^§9!:i^te sugglies^ [Q^t^izials, 

abundance of materials and 

suppl ies 
funded appropriately 
materials 

materials & equipment 

avai lable which mot i vate 

Human i^sti.c gggrSS^b 

Comgetency based aDgrQSBb 

based on measurable 
object i ves 

measurable 

i05^ ghiiosoghy 

provides a philosophy 

Eeri52D5la. social ski 1,1s 

help students become 

social ly acceptable 
elevation of self-concept 
encourage development of 

posit ive self -concept 
ability to make students 

feel good about themselves 
provides for affect ive 

development 
promote feeling of self worth 
develop appropriate social 

skills 
emot ional ly support ing 



35. 9H^~^99!Z99!Zi.£5.? £!:i]2!2i£I:.^i.M[Q 
nign mreresr mareriais 
curr-icuium meermg neeas o*^ 

CUDl Is 

coursie offerings meer neeas 
S< interests 

tasks 8c activities age- 
appropriate 

B^CaiDistrat i.ye leadership ^ 
suggort 

administrat ive involvement 

administrat i ve support & 
leadership 

bui Id ing administrat ive 
support 

accepted by administration 

37. Study skillsi ie£!!Di!2a stra^ 

tegties 

students learning & mastering 
learning st rat eg ies 

38. EyDStiSD^i £££demi_cs 
program supports funcc: ional 

literacy & math skills 
provide enough math i»kills 

for money management 
furict ional program activities 
attaining f unct ional 

read ing /writ ing /math 

39. Q2[0g!2gtl^Dsi.ye grSS!2^[G 
serves most handicapping 

condit ions 

40. Validated instructional 

met hods 
effect ive 



i 
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-'arr II-A Btaf-f Chai-acr en st ics 



2. 



QidnnSMAliD} iDSt r^ucr i^ona 1. 

srructui-e of lEP/ user ulness 
olanning 

curr icul urn understand ing 
ability to write & 
implement lEP 

Ir^strirSetigD^I §kii is 

able to utilize classroom 

ai des 
variety of teaching 

techniques 
individualization of 

instruct ion 
instruct ional/ef f ect i ve 

teaching pr act ices 
lesson presentat ion 
ability to manage instruction 
lDD9vati,ve instruction skills 
creat ivity/inno .'at iveness 
innovat ion 

motivation techniques used 
able to identify with 

ri ght -brained learning 

style 
creat i vity 

ability to motivate reluctant 
students 
dDoyiedge of transition 
knowledge of transition & 

provision of goals 
Qi^ssroom organization skiiis 
able to create & maintain 

struct ure 
good record keeping skills 
demonstrates ablity to 

organize for instruction 
systemat ic/organi zed 
organ i zat ional ski 1 Is 
liEUe EO^D^aewent skiiis 
good time management skills 
time on task 
efficient 

punctual with paper work 
assi gnment s 



10. 



11. 



Dehavioral ly onenrea 
ryoe of aiscipl me, 

c 1 assroom cont ro 1 usea 
behavioral management skills 
individual & group behavior 

management 
classroom management skills 
assertive disci pi ine 
y2Chs cooeerativei^ with staff 

and administration ^ 
cooperates with faculty, 

parents, administration, & 

special ists 
works effectively with 

other teachers 
ability to relate to other 

school personnel 
interaction & approach used 

in working with adminis- 
tration 
f ol low pol icies/guidel ines 

federal, state & local 

agencies 
Wonhs wel 1 with BgOBie 
ability to get parental 

involvement 
ability to interact with 

teenage SPED students 
ability to work with 

commun ity agencies 
ability to maintain intei — 

action with parents 
rapport 

SoQsuitation skij. Is 
communication, with student 

&/or parent 
effective advocacy for program 

with regular teachers 
good communication skills 

with students & staff 
communication skills 
iSShaCSMSd training and 

^>lESEience 
knowledge of content areas 

taught 

trained in secondary SPED 

specif ical ly 
knowledge of special education 

process 

knowledge regarding SPED rule*/ 
regul at ions/methods/ 
techniques 
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BEST COPY AVJ^E 



Drof essi onal resDonsini li- 
t i es 

Drof essi onal i sm 

reacner demons ::r" at es 
et h i ca 1 behav i or 

professional ethics at staff- 
ing 8t parent conferences 

loyalty to school 

ma i nt a i ns profess i ona 1 
at t it udes 
13. EisilZ^ues 2]22f essional. 

current 

use of new/current 

instruct ional techniques 

interest in professional 
growth 

professional ism 

pro f ess i ona 1 growt h 

keeps abreast of subject 
mat t er 

teachers stay up on latest 
trends 

flexible 

compass i onat e 

high level of tolerance 

interest in being 

mentally healthy 
sel f-d isci pi ined 
ded icat ed 

ability to identify 
pr ioY'it ies 

15. B^sessment ski.il.s for 

iJHstruct i,on 
diagnostic & prescriptive 

skills 
assessment & ability to 

translate funding & 

object i ves 
evaluation based on 

eval uat ion instrument 
ability to make educational & 

career assessment s 
d a t a- based p 1 ann i n g 

16. QsyDseiiDS shiiis 

ability to counsel students 

caring interpersonal relat ion- 
ship skills 

provide support needed to 
acquire healthy 
sel f-esteem 

,provide counseling to parents 
& students 



IS. 



19. 

21. 
22. 

23. 



sr udent cenrerea 
1 earning rneory 
aeveloomen-c 
commun 1 1 y basea 
student advocate 

X^£2tL^^ St ud^ §hi.ii^i ie^!ZlCii.n3 

^trategi^es 
1 ist ening ski 1 Is 

basi,c ski.iis 
read ing instruct ion ; 

^SlSssing outcomes . 
survival, skills 

il229IZ29IZ^t§^ vocational /care©!: 
educat ion 
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Survey 3: Weighfing Survey to Directors of Sjpedal Education^ 
School Superintendents, and Teacher Trainers 



Overview 

High school special education programs provide the formal educational experiences for 
those students with disabilities who at least temporarily are unable to benefit from instruction 
in regular education's instructional programs. These special educational experiences 
include 'a diversity of instructional goals and activities. Based on the uniqueness inherent in 
the special education students, some of the educational goals and activities are very 
idiosyncratic as one might expect. To date these goals and activities have not been examined 
nationally or even integrated into a database for analysis. This description, examination, 
and integration were the goals of the National High School (NHS) Project. The NHS project 
involved three integrated research efforts - Bodner, Clark, and Mellard (1987), Knowlton and 
Clark (1989), and the research described here. These three efforts provide integrated, multiple 
perspectives on high schools' efforts to ensure the successful transition of students with mild to 
moderate handicaps to independent functioning within the community. The project's 
intended outcome is to provide educators, researchers, and federal, state, and local level policy 
makers with a framework for evaluating and modeling special education programs. 

In this research effort of the NHS project, five surveys were completed. Each survey 
represented one step in a sequential process of a multi-attribute utility measurement 
(Edwards, 1977). Through the completion of the multi-attribute utility measurement 
procedures, the survey's respondents identified desired attributes and activities of high school 
special education programs. Simultaneously, they identified the desired characteristics of 
training activities for teaching staff which would likely facilitate the acquisition of those 
attributes. The attributes and activities provide a common conceptual framework. This 
framework might be used by numerous groups for such activities as planning, evaluating, or 
further researching high school special education programs, their instructional staff, and pre- 
service teacher training programs. 

The first of the surveys incorporated an open-ended format and was completed by 
directors of special education (DOSE), superintendents of schools (SOS), and pre-service 
teacher trainers (PTT). The initial survey, referred to as the elicitation survey, requested 
respondents to list (a) the attributes and (b) the activities which characterized quality special 
education programs for high school students with mild to moderate handicaps and also of 
quality teaching staff in those programs. The DOSE and SOS were asked to indicate the 
activities of teaching staff on which the staff should be evaluated. This task was altered for the 
PTT. The PTT were asked to indicate the pre-service training activities which would develop 
those desired attributes. 

The first survey's responses from the 265 respondents were grouped into conceptually 
distinct categories by the project's staff. As a result of this categorization, 40 program 
attributes were identified. Similarly, 28 program activities, 23 teacher attributes, and 18 
teacher training activities were identified. Details of the methods and results are described in 
the section titled "Survey 1: Elicitation Survey to Directors of Special Education, School 
Superintendents, and Teacher Trainers," oftentimes referred to in this report as the 
Elicitation Survey. 

The second survey was referred to as the Ranking Survey. In this survey a group of 
sixteen professionals was selected as respondents. These professionals work in various 
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educational settings and were judged knowledgeable about secondary special education 
issues. Their tasks were to review the two lists of attributes from the Elicitation Survey 
(Survey 1), select 15 as the most important from each set, and rank order the chosen 15 in order 
of importance. As a result, two lists of attributes were generated. The exact rankings were 
irrelevant for this project's purposes, but those attributes in the top 10 were retained for 
subsequent use in the succeeding surveys. 

The results of the third survey, the Weighting Survey, are presented in this report. The 
tasks in this third survey were for respondents, (directors of special education, school 
superintendents, and pre-service teacher trainers) to rank and weight two sets of attributes — 
the ten program attributes and ten teacher attributes. The weights provided a ratio-leveled 
ranking of each attribute set. This ratio scaling permits very clear statements regarding the 
respondents' expressed values. For example, one can discern the ratio between any two 
attributes and conclude whether one attribute is valued two, three, four times, or even more as 
compared to another attribute. Such information is not available from Likert-type scaling or 
ranks. These weighted ranks provide a baseline forjudging the importance attached to 
delimited attributes, attributes characterizing quality high school special education programs 
and teaching staff. 

In the planning for this third survey, several issues and alternative courses of action 
were evaluated. Each of these decision points are described in the following section of 
methodological considerations. 

Methodological Considerations 

In MAUM methodology, alternative courses of action or decisions are evaluated against 
defined sets of values. As a consequence of those evaluations, decisions or courses of action 
which most satisfy the expressed values are acted upon. In this research effort, several 
decisions connected to the program and teacher attributes were needed. First, the issue was 
whether the two lists of ten attributes should be differentially weighted. That is, should the list 
often attributes be considered as equally important? Given the apparent conflicts in the lists of 
attributes, the attributes were not likely to be considered as equally viable values and thus, the 
decision was to have the different lists of attributes weighted to reflect the uniquenesses. Two 
issues presented themselves: a) the format of a survey instrument to obtain the rankings and 
weights and b) the selection of the responding groups. 

Survey instrument. In designing the attribute weighting procedures, several 
alternatives were considered. The alternative choices seemed to focus on two variables, the 
amount of time required for the task and the ease with which the weighting could be 
accomplished. The task of assign! ag weights to attributes is accomplished easiest by having 
previously established a hierarchical ordering, i.e., a rank ordering among the attributes on 
an importance dimension. Not having a pre-established ranking presents an added task and 
consequently, added time requirements. In the long run, these added "costs" were considered 
worthwhile. Thus, in designing the survey, sequential steps were added so that the 
respondents would initially separately rank the two sets often attributes and then in a second 
step assign importance weights to the attributes. Since the attributes were ranked, this second 
step was considered simplified. 

Ideally, the resjpondents could have completed the final step in the MAUM procedures. 
The final step of the MAUM procedures is for each of the program activities and teacher 
training activities to be evaluated in terms of its respective set of attributes. Operationally, this 
step requires the respondent to quantify a judgment on the degree to which a particular activity 
facilitates or enhances each attribute. However, this added task was considered as requiring 
more time than respondents were likely to commit and thus the two steps, weighting the 
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attributes and evaluating the utility of each activity in light of each attribute, were separated. 
Each step was judged appropriate for separate surveys. The weights assigned by the 
respondents in this survey were used with the results of the latter surveys in calculating the 
utility measurements. The rationale was that respondents to this survey would have 
comparable values as the values of respondents from the same groups in the latter surveys. 

Response grouns. The perceptions of directors of special education, school 
superintendents, and pre-service teacher trainers were considered as relevant reference 
groups as in the previous surveys and thus these same groups were included in this survey as 
well. Inclusion of these groups was also a matter of convenience. The staff had information 
such as names and addresses and previous experience with these groups. To have changed 
respondents for such a national study would have been both expensive and inefficient. More 
importantly, these reference groups were seen as the best response population for value-driven 
policies and decision-making in program implementation for high school youths with 
handicaps. 

A related issue in planning the survey was the differential response rates among the 
groups on the previous surveys. School superintendents had consistently been the least likely 
to respond to the survey. On the other hand, the pre-service teacher trainers had shown the 
greatest likelihood of responding. The staff assumed that a similar pattern would be 
evidenced in this survey. Knowing previous response rates, the staff chose to increase the 
sample sizes among the school superintendents and the directors of special education. The 
initially proposed sample size of respondents was 125 for each of the groups. The size was 
increased considerably to obtain more actual responses. 

This introductory portion of the report is meant to provide a context within which the 
activities might be understood and to describe the major issues confronting project staff in 
completing this survey. In the following sections, details of the methodology and results are 
presented. 



Method 



Subjects 

Three groups were sampled through the surveys completed in this project: 
(1) superintendents of schools (SOS), (2) directors of special education (DOSE), and (3) pre- 
service teacher trainers (PTT). Three hundred superintendents of schools, 250 directors of 
special education, and 225 pre-service teacher trainers were randomly selected from the 
respective lists of names generated in an eariier phase of the project (see "Subjects" section of 
the Eiicitation Survey). These numbers were selected with a goal of having at least 125 returns 
from each group to ensure a small standard error of measurement, i.e., to ensure stability of 
the data. Table 16 displays the total and proportional numbers of DOSE from each state 
included in the study. The total number (817) is less than the total in the first survey (872) since 
non-respondents from the Eiicitation Survey were culled from the list. 
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Table 16 

Total and Proportional Numbers of DOSE for the Weighting Survey 



Number of Directors of Special Education 



state 


N 


% of Total N 


Proportional N 




Delaware 


27 


3.31 


22 


• 


Iowa 


15 


1.84 


12 




Indiana 


79 


9.67 


63 




Kansas 


71 


8.69 


57 


• 


Kentucky 


78 


9.55 


62 




Missouri 


136 


16.65 


108 




Nevada 


10 


1.22 


8 


• 


New Hampshire 


54 


6.61 


43 




North Carolina 


142 


17.38 


113 




Oregon 


149 


18.24 


119 


• 


Pennsylvania 


29 


3.55 


23 




South Dakota 


27 


3.31 


22 




TOTALS 


817 


100 


652 


• 



Likewise, Table 17 displays the total and proportional numbers of SOS from each state 
included in the study. The total number (1657) is less than the total in the first survey (1714) 
since non-respondents from the Elicitation Survey were culled from the list. 
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Table 17 

Total and Proportional Nnmhftr s of SOS for the Weighting Survey 



Number of Superintendents of Schools 



• 


state 


N 


% of Total N 


Proportional N 




Delaware 


18 


1.1 


10 


• 


Iowa 


219 


13.2 


119 




Indiana 


147 


8.9 


80 




Kansas 


152 


9.2 


83 


• 


Kentucky 


187 


11.3 


102 




Missouri 


305 


18.4 


166 




Nevada 


17 


1.0 


9 




New Hampshire 


54 


3.3 


30 




North Carolina 


75 


4.5 


41 




Oregon 


138 


8.3 


75 


• 


Pennsylvania 


253 


15.3 


138 




South Dakota 


92 


5.6 


50 




TOTALS 


1657 


100 


903 



Materials 

This third survey consisted of an advance mailing to determine interest in participation 
and the mailing of the survey itself. The advance ;;iailing consisted of a letter explaining the 
project and a stamped postcard to be returned only if the recipient chose not to participate in the 
project. A total of 2100 advance letters and postcards were mailed: 900 to SOS, 650 to DOSE, 550 
to PTT. In the process of seeking proportional figures, the actual numbers of letters mailed 
were 903 to SOS (see Table 17) and 652 to DOSE (see Table 16). For the PTT, a list of 550 names 
from the database were randomly selected without replacement. To ensure a national sample 
the criterion of requiring that each state be represented by at least one PTT was established. 
One hundred seventy-one postcards were returned, each postcard indicating that the 
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respondent did not wish to participate in the study. Those persons were deleted from the list of 
names to sample for the survey mailing itself. 

The survey itself was referred to as a Weighting Survey. Identical Weighting Surveys 
were mailed to superintendents, directors and teacher trainers with the exception of the 
survey's last page which solicited different information from the teacher trainers than from 
the directors and superintendents. 

The survey consisted of two parts and instructions were for the respondents to first rank 
and then weight special education program attributes and special education teacher attributes. 
The respective program and teacher attributes included in tiiis Weighting Survey were based 
on the results of the Ranking Survey. The two sets of attributes included in the Weighting 
Survey were the ten attributes which had received the highest ratings from the Ranking 
Survey. The surveys' two parts were counterbalanced; that is, on half of the surveys, 
respondents were instructed to rank and weight pro-am attributes first and on the other half 
respondents were asked to rank and weight teacher attributes first The respondents' 
rankings established the relative importance of each attribute and numerical weights 
indicated how much more or less important each attribute was in relation to the other attributes. 
The goal of this survey was for the respondents to establish an absolute (or ratio) scale among 
the attributes describing (a) special education programs and (b) teaching staff. Appendix H 
holds two copies of the survey intended for DOSE and SOS, one with program attributes listed 
first, and the other with teacher attributes listed first Similarly, Appendix I holds two copies of 
the survey intended for PTT. The advance mailing letter appears in Appendix G. 



Survey Procedures 

Following the advance mailing on April 17, 1987 weighting surveys were mailed on 
May 1, 1987 to 250 DOSE, 300 SOS, and 225 PTT. The mailed materials included a letter of 
explanation, the survey itself, a postage paid return envelope and a pencil. A second set of 
these same materials was mailed the week of May 11, 1987 to those participants who had not yet 
responded to the first mailing. 

Survev Returns 

A summary of the number of surveys mailed and the number of respondents is provided 
in Table 18. The return rates for each group are expressed as percentages below the 'Total 
returns" figure. Superintendents had the lowest return rate with 81 (27.0%) of the 300 surveys 
returned. Eight of the surveys returned by SOS were unusable (see discussion in "Data 
coding" below) and thus not included in the data analysis. The teacher trainer return rate was 
52.9% (119 out of 225). Five surveys returned by PTT were iinusable. The highest return rate 
was among directors of special education with 161 (64.4%) of 250 surveys returned. Fourteen of 
the surveys from DOSE were not used in the data analysis. 
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Table 18 

Mailin? Tarypts anrl Responrfftnt.s fnr t.Vift Wfti phtini^ Siirvpy 

Number of surveys DOSE SOS PTT 

Mailed 250 300 ^ 

Returned usable 147 73 

Returned unusable 14 8 5 



Total returns 161 gl 119 

(Percent) (64.4%) (27.0%) (52.9%) 



Data Coflinfr 

Returned surveys were given an identification number for tracking purposes and were 
inspected to determine usability. Surveys were judged unusable if they were (a) mainly 
incomplete or (b) completed by someone other than the intended respondent's group. A rule was 
adopted forjudging whether a respondent other than the person to whom the survey was mailed 
was acceptable. The rule focused on whether the respondent was likely to reflect the values of 
that group s respondents. For example, if the survey was sent to a superintendent and returned 
completed by a building level administrator then the survey was judged unusable because the 
building administrator was thought to reflect a different set of values or priorities. If, however 
the survey was sent to a superintendent and was returned completed by the assistant 
superintendent, then the survey was ruled usable. Additionally, surveys returned too iate for 
inclusion m the data analysis are reported in the unusable figure. Those surveys judged 
usable were coded for data entry and were entered into a computerized data base file. 

Data Analvsis 

Analyses of data involved procedures for describing the group's responses with 
descriptive statistics and tests for the degree of similarity among the three groups. The degree 
of similarity was evaluated with multivariate procedures, appropriate post hoc comparisons 
and correlational procedures. Three overall tests of the group's centroids are reported- they 
are Pillais, Hotellings, and Wilks. The three yield comparable values but also have 
somewhat different assumptions. The use of the three measures provided a better test of the 
robustness of the findings. Inspection of the data suggests that while the respondents 
differentiated among the attributes, similarities were also noted among the ranks These 
analyses were chosen to elucidate both the commonalities and divergence among the three 
participating groups and the two sets of attributes - staff and program attributes. 

The first step in the data analysis was to establish absolute, or normalized, weights for 
each respondent (afler Edwards, 1977). Absolute weights were obtained by completing the 
following three steps for program and teacher attributes, respectively. The three steps were 
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completed fbrfiacIirfiSIHmdeilt: (l)The weights assigned to each attribute were summed. (2) 
The weight of an individual attribute was divided by the sum of all attribute weights for that 
respondent. (3) The resulting figure was multiplied by 100. These three steps were completed 
twice for each survey, once for the respondent's weights for the program attributes and once for 
weights assigned to the teacher attributes. 

For example, assume that the following weightings were assigned to the program 



attributes by a respondent: 

Attribute Weighting 

Effective staff 130 

Individualized, appropriate instruction 110 

Vocation al/career orientation 30 

Administrative leadership and support 100 
Regular education support and integration 80 
Program support from staff, parents, 

business, and community 70 
Employment success 30 
Post-secondary transition curriculum 10 
Successful independent living 40 
Successful personal and social adjustment 60 

Sum 660 



Following the three steps outlined above, one may obtain absolute, or normalized weights, for 
these attributes. 1) Sum the weightings assigned to each attribute. In this example, that figure 
is 660. 2) Divide each weighting by the sum of all the weights and 3) multiply by 100. Thus, for 
the "Effective staff' attribute: (130/660) X 100 = 19.7. 
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The following absolute weights result: 

Attribute Absolute Weight 

Effective staff 19.7 

Individualized, appropriate instruction 16.7 

Vocational/career orientation 4.5 

Administrative leadership and support 15.2 

Regular education support and integration 12.1 
Program support from staff, parents, 

business, and community 10.6 

Employment success 4.5 

Post-secondary transition curriculum 1.5 

Successful independent living 6.1 

Successful personal and social adjustment 9,1 



The same procedure was followed to obtain absolute weights for teacher attributes. 



Results 



Program Attributes 

This section presents the results of analyses involving the weightings assigned by the 
DOSE, SOS, and PTT to the ten program attributes. 

Descriptive statistics. Table 19 provides the mean weight, standard deviation and 95% 
confidence interval for each of the three respondent groups for each quality special education 
program attribute. For example, the 142 DOSE in the study gave a mean weight of 16.8 to the 
program attribute "Effective staff." The mean weight had a standard deviation of 5.5, and the 
95% confidence interval was 15.9 to 17.7. In comparison, the 67 SOS assigned a mean weight of 
15.6 to "Effective staff." For superintendents the standard deviation was 6.6 and the 95% 
confidence interval was 13.9 to 17.2. Similarly, one may compare directors, superintendents 
and pre-service teacher trainers on each program attribute. 

Another way to consider the data presented in Table 19 is to examine the range of 
weightings given by each group. For DOSE, the weights assigned to program attributes ranged 
from a low of 4.9 to a high of 16.8. The range for SOS was 5.6 to 15.6. PTT had a range of 6.2 to 
15.5. For each group the lowest weight was assigned to the attribute "Post-secondary transition 
curriculum," and the highest weight was given to the attribute "Effective staff." 
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Multivariate tests o f significance . Table 20 includes three multivariate tests of 
significance for program attributes. These tests simultaneously considered the mean weights 
of all ten pn)gram attributes (the centroid) for all three groups and determined whether any 
statistically significant differences existed. The criterion value is calculated by considering 
the number of groups being compared, the number of dependent variables, and the sample size. 
Commonly, an alpha value of .05 or less is considered significant. As Table 20 indicates, each 
multivariate test yielded a significant difference among the superintendents', directors' and 
pre-service teacher trainers' weightings of the program attributes. This outcome is interpreted 
as meaning that the weighting by at least one group was reliably different firom another 
group's weighting of the attribute. 



Table 20 

Multivariate Tests f^f Significance f or Program Attribut^fi = 2. M = 1/2 
N = 153 1/2^ 



Test Name Value Approx. F Hypoth, DF Error DF 



Pillais 


.15538 


2.61121 


20.00 


620.00 


.000 


Hotellings 


.16865 


2.59727 


20.00 


616.00 


.000 


Wilks* 


.85058 


2.60424 


20.00 


618.00 


.000 



*Note that the F statistic for Wilk's Lambda is exact. 

Univariate r-tftfitr?=T. The univariate F-test was selected as a post hoc test, that is, the F-test 
was performed if the multivariate tests indicated a significantp value. The F-test statistic 
examined the equality of group means on each attribute. The univariate F-test considered 
each attribute separately and thus provided more detailed information than the multivariate 
test. Table 21 displays the univariate F-tests for program attributes. A p value of .05 or less 
indicates that at least one group (DOSE, SOS or PTT) assigned a significantly different 
weighting to that attribute than one or both of the other two groups. As indicated in Table 21, the 
program attribute "Vocational/career orientation" had a p value of .001. This indicates that 
one or more of the three groups assigned a significantly different weight to this attribute. This 
test, however, does not identify which of the groups differed from the other group(s). Likewise, 
the attributes "Regular education support and integration," "Post-secondary transition 
curriculum," "Successfiil independent living," and "Successfiil personal and social 
adjustment" also had significant p values indicating a difference in mean weighting among 
the groups. 
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Table 21 

Univariate F-tests for Program Attributes with (2,318) D.F. 



Attribute 


Hypoth. MS 


Error MS 


F 


p 


Effective staff 


70.59483 


33.24015 


2.12378 


.121 


Individualized, appropriate instruction 


4.75535 


26.63601 


.17853 


.837 


Vocational/career orientation 


104.38785 


15.19178 


6.87134 


.001 


Administrative leadership and support 


66.40688 


27.55791 


2.40972 


.091 


Regular education support & integration 


83.87742 


19.07401 


4.39747 


.013 


Program support from staff, parents. 










business, and community 


24.86085 


13.83931 


1.79639 


.168 


Employment success 


7.01189 


20.37472 


.34415 


.709 


Post-secondary transition curriculum 


52.88685 


13.69941 


3.86052 


.022 


Successful independent living 


95.58055 


25.73322 


3-71429 


.025 


Successful personal & social adjustment 


84.92266 


25.64664 


3.31126 


.038 



Scheflfi^ procedure . The Scheff(6_ analysis presented in Table 22 was completed only for 
those variables which yielded a significant p value in the univariate F-tests. This post hoc 
procedure indicates among which groups the difference in mean weights exists. Thus, this 
analysis provides more complete information about differences in mean weights than does the 
univariate F-test. Note that Table 22 displays only four program attributes while the 
univariate F-test (Table 21) indicates that the groups assigned significantly different mean 
weights to five attributes. The ScheffS. procedure is a conservative test meaning that it 
includes an adjustment in the criterion value for statistical significance depending on the 
number of group means compared. For these tests the adjustment maintained a constant alpha 
level O = .05) and thus controlled the likelihood of Type I errors (Glasnapp & Poggio, 1985; 
Hayes, 1981). As a consequence, the program attribute "Successful personal and social 
adjustment," which was identified as having significantly different group means on the 
F-test in Table 21, was not identified as such by the more conservative SchefF^j)rocedure. 



NHS Weighting Survey 10/19/92 



132 



113 



Table 22 

Results of SchefF^ Procednres Ca = .05^ for Special Education Program Attributes 



Comparison Groups 
SOS SOS DOSE 



vs vs vs 



Attribute 


DOSE 


PTT 


PTT 


V ocaLionai/career orjentation 




b.4 






VS 


VS 


iNb 




8.0 


8.6 




Regular education support 






10.4 


and integration 


NS 


NS 


vs 








8.8 


Post-secondary transition 






4.9 


curriculum 


NS 


NS 


vs 








6.2 


Successful independent 


10.1 






living 


vs 


NS 


NS 




8.1 







Note. The tabled values are the respective group mean weights. The larger the weight, the 
greater importance ascribed to the attribute. 

NS = not significant; DOSE = Director of Special Education; SOS = Superintendent of Schools; 
PTT = Pre-service Teacher Trainer. 
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Table 22 displays the program attributes which had statistically significant differences 
in the mean weights of DOSE, SOS, and PTT. For example, the attribute "Vocational/career 
orientation" was assigned significantly different weights by SOS and DOSE and by SOS and 
PTT. That is, the mean weight of SOS for this attribute was 6.4 which was found to be 
significantly different from the DOSE weight of 8.0 and the PTT weight of 8.6. There was no 
significant difference indicated between the mean weights of DOSE and PTT for this attribute. 

Univariate homogeneity of variance tests . An underlying assumption of the F-test 
(Table 21) is that the comparison groups'(i.e., directors of special education, superintendents 
of schools, and pre-service teacher trainers) scores have equal variances. That is, that each 
group's distribution of scores has similar variability. The F-test, however, is not seriously 
affected by violations of its underljnng assumptions. Even significant differences in the 
variances of comparison groups do not invalidate the test (Keppel, 1973). Nevertheless, for the 
purpose of completeness and for the information of the reader, univariate homogeneity of 
variance tests for the program attributes are presented in Table 23. Recall that an alpha value 
of .05 or less is considered statistically significant. Five attributes in Table 23 have p values 
of .05 or less, meaning that for these attributes the variances of DOSE, SOS and PTT are 
significantly different. These differences, however, should not be interpreted as invalidating 
the F-test. 
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Table 23 

Univariate Hnrnfigenftitv of Variance Test.s for Program At.fn'hnf.ps 





Bartlett-Box F 




Attribute 


(2,182264) 


I 


Effective staff 


1.89051 


.151 


Individualized, appropriate instruction 


10.75866 


.000 


Vocational/career orientation 


4.24662 


.014 


Administrative leadership and support 


8.44136 


.000 


Regular education support and integration 


4.42036 


.012 


Program support from staff, parents, business, 






and community 


,45633 


.634 


Employment success 


,31149 


.732 


Post-secondary transition curriculum 


1.04686 


.351 


Successful independent living 


,20852 


.812 


Successful personal and social adjustment 


3,16188 


,043 



Rank order of attributes. Table 24 displays the program attributes in rank order by mean 
weights. Due to the issues addressed in the research and our own interests, DOSE were chosen 
as the reference group. Of the three groups, the DOSE have the most direct responsibility for 
daily programming decisions and overall policies. Therefore, the attributes are listed in 
order of the DOSE ranking, and the SOS and PTT rankings may be compared to that of DOSE. 
Kendall's coefficient of concordance for the three groups* rankings of the program attributes 
was .94. In other words, the three groups ranked the attributes very similarly. For instance, 
note that each group ranked the same attributes first, second, fifth and tenth. Another 
interpretation of Kendall's coefficient of concordance is the degree to which the groups used the 
same criteria in evaluating the choices. The high value reflected here suggests very similar 
criteria were shared by the respondents. 
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Table 24 

Special Education Prngra-m Attributes in Rank O rder as Weighterl hv Survey Respondents 

DOSE SOS PTT 

Program attribute N = 142 N = 67 N = 112 



Rank (Mean wt.) Rank (Mean wt.) Rank (Mean wt.) 



Effective staff 


1 


(16.8) 


1 


(15.6) 


1 


(15.5) 


Individualized, appropriate 














ill a true Llun 


9 


\i.O.O) 


o 




9 




Administrative leadership and 














support 


3 


(11.4) 


4 


(10.5) 


3 


(12.2) 


Regular education support and 














integration 


4 


(10.4) 


7 


(9.7) 


6 


(8.8) 


Program support from staff, parents, 














business, and community 


5 


(10.3) 


5 


(10.2) 


5 


(9.4) 


Successful personal and social 














adjustment 


6 


(9.5) 


3 


(11.3) 


4 


(10.5) 


Successful independent living 


7 


(8.1) 


6 


(10.1) 


8 


(8.4) 


Vocational/career orientation 


8 


(8.0) 


9 


(6.4) 


7 


(8.6) 


Employment success 


9 


(7.3) 


8 


(7.8) 


9 


(7.7) 



Post-secondary transition 

curriculum 10 (4.9) 10 (5.6) 10 (6.2) 

Note. DOSE = Director of Special Education; SOS = Superintendent of Schools; 

PTT = Pre-service Teacher Trainer. 

Identical rankings, however, do not imply an equal weighting. For example, assume 
that two respondents ranked "Effective «tafr' first (most important) and "Individualized, 
appropriate instruction" second. Assume fiirther that one respondent weighted "Effective 
staff' as three times as important as "Individualized, appropriate instruction" while the other 
respondent weighted "Effective staff' as only twice as important. Although both respondents 
assigned equal rankings to the attributes, the weightings dift-^red. These differences may be 
critical for decisions and setting priorities in the groups' respective program planning and 
implementation. 
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Teacher Attributes 



In addition to the program attributes, the respondents were also asked to weight the 
attributes of quality teachers. On the basis of these attributes one might identify important 
qualities of special education teachers in a secondary setting. The results of the three groups' 
weightings were analyzed following the same procedures used with the program attributes and 
those findings are reported here. 

Descriptive statistics. Table 25 presents the mean weights, standard deviations and 95% 
confidence intervals for each group's weightings of teacher attributes. For example, the 141 
DOSE assigned a mean weight of 15.3 to the teacher attribute "Instructional skills." The mean 
weight had a standard deviation of 5.1, and the 95% confidence was 14.5 to 16.2. In 
comparison, for the same attribute, SOS assigned a mean weight of 14.1. The standard 
deviation was 4.8, and the 95% confidence interval was 12.9 to 15.3. Likewise, one may 
compare the DOSE figures to those of SOS and PTT for the other attributes. The range of values 
for mean weights assigned by DOSE was 4.9 for to 15.3. For SOS, the range was 4.6 to 14.1, and 
for PTT the range was 5.6 to 15.1. For each group, the lowest mean weight was assigned to the 
teacher attribute "Knowledge of transition" while the highest mean weight was given to 
"Instructional skills." 
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Multivariate tests o f significance . Multivariate tests of significance for teacher 
attributes are displayed in Table 26. These tests simultaneously tested for differences among 
the mean weights of all ten teacher attributes (the centroid) for all three groups. The purpose of 
this procedure was to determine whether any statistically significant differences existed 
among the centroids of the groups. An alpha value of .05 or less was considered to indicate a 
statistically significant difference. Note that all three multivariate tests yielded a 
statistically significant difference in the weightings of DOSE, SOS, and PTT. 



Table 26 

Multivariate Tests of Siprnific^^nce for Teacher Attr ibutes (S = 2. M = 3 1/2, N = 148 1 m 





Test Name 


Value 


Approx. F 


Hypoth. DF 


Error DF 


P 




Pillais 


.14730 


2.38513 


20.00 


600.00 


.001 


• 


Hotellings 


.16222 


2.41706 


20.00 


596.00 


.001 




Wilks* 


.85685 


2.40117 


20.00 


598.00 


.001 



Note that the F statistic for Wilk's Lambda is exact. 



Univariate F-testS> The univariate F-test was chosen as a post-hoc analysis. The F-test 
examined the equality of group means for each attribute. Additionally, the F-test examined 
each attribute separately and so provided more detailed information than the multivariate 
tests. Table 27 displays the univariate F-tests for teacher attributes. Five teacher attributes had 
a p-value of .05 or less. This indicates that for these five attributes at least one group (DOSE, 
SOS, PTT) assigned a significantly different weighting than one or both of the other groups. 
For example, as indicated in Table 27, the teacher attribute "Curriculum & instructional 
planning skills" had a p-value of .004. Thus, one or more of the three groups assigned a 
significantly different weight to this attribute. However, this test does not identify which of the 
groups differed from the other group(s). In addition to "Curriculum and instructional 
planning skills" the attributes "Working well with people," "Classroom organization 
skills," "Skill in assessing outcome," and "Incorporating vocational/career education" also 
had significant p-values indicating a difference in mean weighting among the groups. 
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Table 27 

TTnivflriflte F -t-ftsts for Tftflnhpr Att.rihut.Pfi with (2.3n«^ D F 



Attribute Hypoth. MS Error MS 



Instructional skills 


31.10188 


22.71974 


1.36894 


.256 


Assessment skills for planning 










and instruction 


23.76496 


17.11513 


1.38854 


.251 


Curriculum and instructional 










planning skills 


109.37741 


19.64769 


5.56693 


.004 


Working well with people 


138.90771 


37.70831 


3.68374 


.026 


Know'jdge of transition 


23.61794 


12.99271 


1.81778 


.164 


Classroom organization skills 


123.92559 


17.43914 


7.10618 


.001 


Behavior management skills 


20.46485 


19.91405 


1.02766 


.359 


Working cooperatively with staff 










and administration 


31.57592 


20.65058 


1.52906 


.218 


Skill in assessing outcomes 


71.02986 


15.34131 


4.62997 


.010 


Incorporating vocational/career 










education 


67.91117 


16.57378 


4.09751 


.018 



Schefy^ procedure. The Scheffej)rocedure was chosen as a second post hoc analysis and 
was completed only for those teacher attributes which yielded a significant p-value in the 
univariate F-tests. The Scheffi6j)rocedure identifies among which groups the difference in 
mean weights exists. Table 28 displays the ScheflK.analysis on teacher attributes. As shown 
in the table, the attribute "Curriculum and instructional planning skills" was assigned 
significantly different weightings by SOS and PTT. The mean weight assigned by SOS was 
10.3, while the mean weight given by PTT was 12.7. This difference in mean weights was 
significant at the .05 level. Note that for this attribute no significant difference was evidenced 
between the weightings assigned by SOS and DOSE or by DOSE and PTT. 
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Table 28 

Results of Schefife Procedures (a = .05^ for Special Education Teacher Attributes 



Comparison Groups 





SOS 


SOS 


DOSE 




vs 


vs 


vs 


Attribute 


DOSE 


PTT 


PTT 


Curriculum and instructional 




10.3 




planning skills 


NS 


vs 


NS 






12.7 




Working well with 




13.8 




people 


NS 


vs 


NS 






11.3 




Classroom organization 




12.4 




skills 


NS 


vs 


NS 






9.9 




Skill in assessing 


8.1 






outcomes 


vs 


NS 


NS 




6.5 






Incorporating 




5.2 




vocational/career 


NS 


vs 


NS 


education 




7.1 





Note: The tabled values are the respective group mean weights. The larger the weight, the 
greater importance ascribed to the attribute. 

NS = not significant; DOSE = Director of Special Education; SOS = Superintendent of Schools; 
PTT = Pre-service Teacher Trainer. 
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Univariate homogeneity of variance tests . As mentioned in the program attribute 
discussion, an underlying assumption of the F-test, presented in Table 27, is that the 
comparison groups have equal variance. However, the P-test is not seriously affected by 
violations of its underlying assumptions (Keppel, 1973). Nevertheless, in the interest of 
completeness and for the information of the reader, univariate homogeneity of variance tests 
for the teacher attributes are presented in Table 29. Three attributes have alpha values of .05 or 
less indicating that for these attributes the variances of DOSE, SOS and PTT are significantly 
different. These differences, however, should not be interpreted as invalidating the F-test. 



Table 29 

Univariate Homogeneity of Variance Tests for Teacher Attributes 



Attribute 



Bartlett-Box F 
(2, 182264) 



Instructional skills 2.13363 

Assessment skills for planning and instruction .97208 

Curriculum and instructional planning skills 1.56529 

Working well with people 2.43694 

Knowledge of transition 3.94003 

Classroom organization skills 6.06451 

Behavior management skills 8.03950 
Working cooperatively with staff and 

administration 2.42278 

Skills in assessing outcomes 1.38367 

Incorporating vocational/career education .06484 



.119 
.378 
.209 
.088 
.020 
.002 
.000 

.089 
.251 
1.000 



Rank order of attrihnfec;. Table 30 exhibits the teacher attributes in rank order by mean 
weights. As noted previously, DOSE serves as the reference group and thus the attributes are 
listed in order of the DOSE ranking. The SOS and PTT rankings may be compared to that of 
DOSE. Kendall's coeflRcient of concordance was calculated as .93. That is, the three groups 
ranked the attributes very similarly. For example, each group ranked "Instructional skills" 
first. Additionally, the groups ranked the same attributes seventh, eighth, ninth and tenth. 
Another way to interpret Kendall's coeflHcient of concordance is as a reflection of the degree to 



NHS Wd^ting Survey 10/19/92 123 



ERIC 143 



which the groups used the same criteria in evaluating the choices. A coefficient of .93 suggests 
that very similar criteria were shared by the respondents. 

Table 30 

Special Education Teacher Attributes in Ran k Order as Weighted hv Survey Respondents 

DOSE SOS PTT 

Program attribute N = 141 N = 65 N=l 05 

Rank (Mean wt.) Rank (Mean wt.) Rank (Mean wt.) 



Instructional skills 


1 


(15.3) 


1 


(14.1) 


1 


(15.1) 


Working well with people 


2 


(12.9) 


2 


(13.8) 


4 


(11.3) 


Curriculum and instructional 














planning skills 


3 


(11.8) 


6 


(10.3) 


2 


(12.7) 


Assessment skills for planning 














and instruction 


4* 


(11.0) 


5 


(10.5) 


3 


(11.6) 


Classroom organization skills 


4* 


(11.0) 


3 


(12.4) 


6 


(9.S; 


Behavior management skills 


6 


(10.8) 


4 


(11.7) 


5 


(10.7) 


Working cooperatively with 














staff and administration 


7 


(9.8) 


7 


(9.1) 


7 


(8.8) 


Skill in assessing outcomes 


8 


(6.5) 


8 


(8.1) 


8 


(7.6) 


Incorporating vocational/ 














career education 


9 


(6.3) 


9 


(5.2) 


9 


(7.1) 


Knowledge of transition 


10 


(4.9) 


10 


(4.6) 


10 


(5.6) 



Note: indicates a tie. DOSE = Director of Sp(icial Education; 

SOS = Superintendent of Schools; PTT = Pre-sv^rvice Teacher Trainer, 
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Discussion 

This research effort in the National High School Project had two goals. The first goal 
was to identify three professional groups* perceptions of the desired qualities of special 
education programs for students with mild to moderate handicaps in high school settings. The 
second goal was to identify the same three groups' perceptions of the desired qualities of 
instructional staff for students with mild to moderate handicaps in high school settings. A 
description of desired program attributes and quality teaching staff attributes was identified 
as critical in understanding and directing policy and practice. The three groups whose 
perceptions were chosen to include were national samplings of directors of special education, 
school superintendents, and pre-service teacher trainers. To accomplish the goals, 
information on two factors were considered important: (a) identifying the desired attributes of 
the programs and instructional staffs and (h) identifying the relationship of the particular 
program activities to the identified attributes. 

In two previous surveys the desired attributes of programs and staff were elicited and 
reduced to two sets of ten attributes, one set relevant to special education programs and one set 
relevant to instructional staff. Similarly sets of program activities and pre-service activities 
were identified. In this third survey, the weighting survey, respondents ranked and weighted 
the desired attributes to establish the attributes' numerical weighting of importance, 
comparing one attribute to the others in the set. The results of this weighting survey were given 
in the preceding section. In this section those results are interpreted in light of current reforms 
in regular and special education and future needs in American society. In addition, since 
internal validity of the project is important to consider, this survey's results are compared with 
the results from the earlier surveys in this project. Last, an ideal model for program and staff 
characteristics is described from the respondents' perspectives. 

Reforms in Regular and Speci al Education 

Mitchell and Encarnation (1984) have argued that three themes have dominated reform 
movements in this century: efficiency, equity, and most recently, quality. The concerns with 
increased quality or excellence are grounded in the perception that the public school experience 
is less beneficial than expected and that the consequences are very negative. Two dominant 
avenues have been followed to increase the quality of the educational experience. The major 
thrust to improve quality has been to increase accountability. That is, if school 
administrators, teachers, and students are held more accountable, the indicators of quality 
will reflect improvements: test scores will increase, dropouts will decrease, teachers and 
parents will be more satisfied, economic productivity will increase, and so on. These 
indicators reflect the current value systems emphasized in decisions about the nation's 
schools. The second avenue has been an increase in academic standards, to set higher 
standards for students to attain. The emphasis is on improving reading, writing, 
mathematics, and content knowledge of the sciences. Little if any mention is given to 
vocational or career coursework, which is presumed developed in post-secondary settings. 
The increased standards have been implemented as additional requirements: added hours in 
school, added days of school, added required courses, and added assessments. For obvious 
reasons, this approach might be thought of as an "additive model" of school reform. What this 
approach fails to consider is the interaction among student characteristics, teacher skills, 
administrative policies, and their relationship to defined outcome criteria or goals for 
education. Additional requirements or even money are insufficient to ensure that the product 
or outcomes of education will be of higher quality. 

While the direction of regular education has been to increase educational quality, 
special education's emphasis has taken a different tack. While special education's reforms 
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are focused on improving the quality of the special education programs, the approach 
emphasizes a better integration of the special education student into the high school's 
mainstream of academic, social, and vocational curricular activities. These scenarios are 
competing over the role of regular education. Regular education's drive for excellence is not 
compatible with ensuring greater opportunities for students who previously had failed. 

Within special education two topics have dominated the reforms: (a) the regular 
education initiative and (b) the transition of special education students from high school to 
other environments. The regular education initiative (REI) (Reynolds et al., 1987) was 
initiated by a group of special educators concerned with the misidentification of students as 
handicapped, the growing numbers of students identified as handicapped, and the perceived 
failure of special education interventions to improve achievement. The proponents pictured 
the education system as being responsible for all students, but that special education had 
become a separate or disjointed educational system with unnecessary proceduralism. In turn, 
an outcome was that the structure of special education had removed regular education from 
reasonable responsibilities for accommodating students. The goals of the REI were to remove 
the barriers and procedures perceived as perpetuating the two systems and to maintain low 
achieving students in the regular classroom setting. 

The transition movement has emphasized the need for preparing students with 
handicaps to assume greater independent functioning and social responsibility in the 
community once they leave the hi^ school setting (Clark & Knowlton, 1987). Several studies 
have documented the difficulties individuals with handicaps have in adjusting to independent 
living in the community (Edgar, 1987; Halpem & Benz, 1987; Hasazi et al., 1985; Mithaug et 
al., 1985; Viadero, 1989). The transition movement has directed attention to the curricular 
goals for students and the instructional methods for meeting those goals. The emphasis has 
been to increase fimctional skill levels and educational experiences closely aligned with 
community living demands. 

Teacher training reforms have been promoted along with other reforms in education 
(Clark, 1988; Combleth, 1986; Futrell, 1986; Schulman, 1986; Warren, 1985). These reforms 
generally have been directed at increasing the entry level requirements for teachers, e.g., 
added academic preparation, satisfactory performance on a teacher competency exam, and a 
probationary period. As in other segments of reform the goals have not been clearly defined. 
Improvements are sought, but the model or criterion has not been specified for how best to 
accommodate the heterogeneity of the student population and the desired outcomes of the K-12 
educational experience. 

In the following text, the results from the weighting survey are discussed by referencing 
the efforts in regular and special education reforms and teacher training. An appropriate 
frame of reference is that this activity is not a referendum on a particular movement or theme 
in education. Rather, the ranks and weights provide a description of how three professional 
groups in education evaluated the merits of a defined set of attributes for high school level 
special education and pre-service programs. Within that closed set, ranks and weights permit 
comparisons among the attributes and among the responding groups. 

Regular and special education reforms an d weighting survfiv rpgnltR . The weights 
assigned by the three respondent groups (directors of special education, superintendents of 
schools, and pre-service teacher trainers) for the ten program attributes were highly correlated 
(r = .94). The inference was that the three groups were operating from a comparable frame of 
reference. This frame of reference was a shared model of desired program characteristics. 

The ten program attributes were not particularly a close match for the attributes which 
are described as important in the regular education reform. However, the need for "Effective 
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staff," "Program support from staff, parents, business, and community", and a desire for 
students' "Employment success" are frequently mentioned as important in the reform 
literature. "Effective staflT' was the most important characteristic from each group's 
perspective and was weighted comparably by the groups. Thus, from these groups' view the 
emphasis was placed on the staffs qualities for ensuring the success of the special education 
programs. Interestingly, a recent opinion poll of regular education teachers reported that 
teachers have low morale, feel unappreciated, and believe that the greatest problem in 
education is the lack of parental support (Elam, 1989). A paradox is evident. While an 
effective staff is considered the most important characteristic by these three groups, the largest 
segment of today's teaching staff is very dissatisfied and blames almost everyone but 
themselves for recognized school problems. From the teaching profession's perspective, the 
lack of support is the greatest problem to b^ confronted. If support was broader, their 
effectiveness would be increased. At the same time, the reader should recall that the three 
responding groups were not criticizing the staffs quality, but recognizing that the staff was the 
most important attribute of a successful educational program. 

Futrell (1986) described the current reforms in education as largely teacher reforms, and 
thus would disagree with the "additive model" described above. From her perspective, the 
needed reforms are not with teachers but rather with school structure such that generated 
reforms are classroom-based or bottom-up changes, rather than administrative or top-down 
changes. In addition, she recommends that issues of teacher competencies be judged by the 
teaching profession itself rather than by administrative, policy, or trainer agenda. These 
views illustrate some of the diversity confronting those interested in improving the quality of 
programs. 

For each of the respondent groups, program support was assigned the fifth position, while 
employment success had the ninth position for the directors of special education and pre- 
service teacher trainers and the eighth position for school superintendents. We suggest that a 
distinction exists made between the goals of special education as prioritized by the respondents 
and regular education reforms. The observation has been made by others (e.g. Sapon-Shevin, 
1987) that the reform reports have all but ignored references to special education. The omission 
might be interpreted as a conceptual distinction in educational pro-ams and goals, that the 
uniqueness of special education deserves distinct treatment. 

Two themes were identified as dominating reforms in special education: the regular 
education initiative and the transition movement. The rankings include varying levels of 
support for increased integration between special education and regular education. 
Interestingly enough, the attribute, "Regular education support and integration," was one 
attribute on which a reliable diflFerence was noted between the groups. The directors of special 
education assigned a significantly higher weight to this attribute (mean = 10.4, s.d. = 4.2) than 
the pre-service teacher trainers did (mean = 8.8, s.d. = 4.9). The directors of special education 
and pre-service teacher trainers are two groups which one might expect to have a close level of 
agreement. Since the trainers have responsibility for filling personnel needs of district 
programs, they would be expected to have a careful understanding of those needs. These two 
group's respective ranks were four and six. The rank position suggests that the construct has 
some importance to the groups, but obviously the link between special and regular education is 
not the most important aspect of their programs' success. 

The discussion around the transition movement has had little impact on these three 
groups' decisions regarding desirable program attributes for special education. For each 
group, the attribute "Post-secondary transition curriculum" was ranked as least important. 
The low ranking, however, was not indicative of even a more important diflFerence. That 
difference was evidenced in the weighting. "Post-secondary transition curriculum' was also 
weighted differently by the directors of special education and pre-service teacher trainers. 
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The respective mean weights were 4.9 and 6.2 and the difference was statistically significant 
Both groups ranked it last, but the directors of special education viewed it as even less 
important thari did the pre-service teacher trainers. The inference might be that the 
discussions around the transition concept have not had an impact on their thinking about the 
goals of special education. Alternatively, awareness of transition issues actually may not be 
critical to their programs' success. 

Ideal model of program and staff 

The survey data provide a glimpse of these three groups' emphasis for a model special 
education program and teaching staff. Perhaps of greatest interest is the shared consen^-vs 
among these three responding groups. This shared consensus was evidenced in two data: the 
high intercorrelations among the groups' rankings, (.94 and ,93 for the program and teacher 
attributes respectively) and second, the comparability of the attributes assigned weights. The 
ranks assigned to the two attribute sets were very similar and thus is reflected in the high 
intercorrelations. Comparability of the weights was evidenced in that few comparisons 
among the weights were statistically different. Even in those instances of different weights, 
all three groups did not differ among themselves. Only two gpronps differed between 
themselves and the differences were not always between the same two groups. Thus, we infer 
from these data that the three groups do exhibit similar values for programs and staff. Each 
group particularly values an effective staff and ensuring that the student's instruction is 
individualized and appropriate. Also of interest is that curricular outcomes ("Successful 
personal and social adjustment," "Successful independent living" and "Emplojrment 
success") for students were generally secondary in importance. The focus of a quality 
program is viewed from its organizational approach and structures rather than from the 
program's outcomes. One might speculate that from the administrative perspectives of these 
respondents, the outcomes will be satisfactory if other program features are functional. Hence, 
the actual content is less important to emphasize. Ironically, the groups' values on effective 
staff and organizational approach as the assumed best "means to an end" could be interpreted 
by some as possible "constraints to an end." That is, good organizational structures and 
effective teaching that are content- and outcome-free may lose inadvertently their sensitivity 
and focus on students' needs. We are concerned that the apparent qualities of a program have 
such little emphasis on the students' performance or outcomes of the educational experience. 

The other obvious point from the data is the close agreements shared by the pre-service 
teacher trainers with the district level administrators. While several reform reports have 
been critical of training programs, these data suggest a strong basis of shared beliefs. 
Interestingly, the responses across both the Elicitation Survey and this surv^ey indicate a 
shared perspective. This finding might lead to closer discussions of potential differences. If 
the pre-service teacher trainers are considered as the innovators for education and principals 
in the reform movement, then a greater distinction would have been expected. The trainers 
appear to be attuned to the same perspectives as local administrators. A good example is that 
"Post-secondary transition curriculum," which is a reform effort in special education, was 
consistently weighted least by the trainers (as well as by the other two responding groups). At 
least in this instance, a reform effort has not been translated into an important quality for 
special education. Similarly, in the survey data regarding valued teacher attributes, 
"Knowledge of transition" was considered least important. 
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RecomTTiendations 

We want to address the issue of recommendations regarding models of progpram and 
staff attributes. As others (D. Clark & A-stuto, 1986; Mitchell & Encamation, 1984; Resnick & . 
Resnick, 1985; ) have indicatedv the national policy in education has emphasized the political 
involvement of various levels of government. This political involvement has changed 
depending on the governmental level, e.g., federal, state, or local. At the federal level, the 
most recent themes have been to de-emphasize the role of the federal government, reduce the 
level of monetary support, decentralize the federal role, deregulate the previous requirements, 
and disestablish education as a cabinet level position (Clark & Astuto, 1986). These themes 
have been central, and simultaneously initiated with calls for reform to solve the perceived 
crises in education, primarily by emphasizing a call for excellence. Thus, the federal level 
response has been to declare that education is in need of far-reaching reform, but concurrently 
relieving itself of any participation to address the stated crises. Apparently, the perception is 
that states should take the leadership role in responding to the needs for educational reforms 
which in turn promote excellence. The federal agenda addresses educational issues of 
administration and funding, but does little to prescribe content except to encourage the ^ 
outcomes considered as excellent. Interestingly, the one federal initiative that has specified a 
clear outcome and content criterion is that of transition from school to work. Somehow that 
initiative has not had a generalized effect on superintendents of schools, directors of special 
education, and special education teacher trainers. 

States have recognized the challenges in educational reforms and have attempted to 9 
respond. The states' efforts have been to alter the administrative mechanisms which on first 
blush appear to impact education, e.g., length of school day, the number of days in a school 
year, teacher certification requirements, use of minimal competency testing, increased 
graduation reqmrements, and distinctions among completion certificates and diplomas. 
Within these contexts of federal and state activities we offer three recommendations. 
Certainly, additional recommendations could be offered, and yet the limitation of three items 
maintains a focus on those aspects which appear most problematic from our national study. 
We recommend that:. 

1) Both federal and state governments develop an educational agenda which addresses 
the conflicting values and desired outcomes in education for a wide range of abilities 
and an increasingly culturally and socially diverse population. These conflicts 
involve such areas as desired curricular content and skills expected of all students, 
responding to the unique learners' needs for specified instructional methods, and 
providing options within the curriculum which diversify the post-secondar}' 
instructional opportunities. 

2) Within the service deliveiy to students in special education^ defined go^l^ be 
identii^ed. These goals must address not only the expected performance of students, but 
also the instructional processes and options available for realizing those goals. The 
quality of high school special education programs appears confounded by a multitude of 
goals which in turn minimizes accountability. 

3) Training of hvgh sdiool special education staffbecome a priority concern in federal 
and state efforts; related to i)ersonnel preparation. Our third recommendation parallels 
the concerns stated and the recommendations made by Bursuck & Epstein (1986), 
Clark (1984), Mclaughlin, Valdivieso, Spence & Fuller (1988), and Weisenstein 
(1986). While staff quality was reported in our data as fundamental to a valuable 
special education program, those specific characteristics of the teaching staff cited 
place a priority on classroom management and de-emphasize aspects of the particular 
curriculum. For example, while attributes of classroom environment and teacher 
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skills can be readily identified, the choice of content is less clearly defined. This 
sitiiation suggests liiat the expectations of the educational experience in terms of 
outcomes are less well defined. 

The educational reforms at the local level are not dependent on state and federal 
initiatives. The local district as the actual delivery service exercises direct control on 
educational planning and implementation. This responsibility is significant and yet not 
emphasized sufficiently. Our recommendations for the local districts are thus very directed at 
a grass roots level perspective of how a district might initiate reforms. We recommend that: 

1) Hie local districts should address these issues and establish their own agenda of 
self-improvement. Halpem (1987) provided one methodology which districts might 
adopt to evaluate the importance of defined program standards and the need for 
improvement in those areas. This survey's data suggest a striking uniformity 
between directors of special education and school superintendents. That shared 
perspective should thus assist them as they move to respond to the numerous issues 
raised regarding the relationship between special education and regular education 
(e.g., Sapon-Shevin, 1988; Reynolds, Wang.. Sz Walberg,1987) and the provision of a 
transition curriculum (c!^., Edgar, 1987). 

2) LEA'S must move beyond the perspective that an eflfective staff is the determinant of a 
program's quality. The emphasis on a quality program includes clearly defined 
desired outcomes and then procedures for monitoring progress toward those outcomes. 
With these directions, LEA staff can expect curricular as well as organizational 
changes if these recommendations seriously were implemented. These changes would 
influence such factors as desired staff characteristics, service delivery methods, exit 
documents, and parental participation opportunities. 

Pre-service teacher trainers provide an integral role with the preparation of 
instructional staff and, quite likely, the staffs continued development through such activities 
as in-service training. Recall from the three responding groups* perspectives that the 
effectiveness of the instructional staff was the most important af^tribufo cf a quality special 
education program. Within this context, our recommendations rej-rardin^ trpmir:g are also 
purposefully focused. 

1) Adopt standards vi^liich e3q)licit[y formalize tbe Tie^aticii^hip bet w^eeB (a) stiAtr^e and 
district level goals and (b) pedagogy and training e^r^nences. beli we that a more 
cooperative arrangement among districts and trainiiig iastitutjons is desirable. 
Mclaughlin et al. (1988) detailed the consternation betw^-er SEA ent? pre-service 
trainers regarding the lack of a shared perspective on i,h6 des>r.^:i ^^ua]^ties of 
instructional staff. These differences were not noted in our aat i. liec^li the very high 
intercorrelation among the three responding groups' rankings of the desired teacher 
attributes. Perhaps the real difference is not conceptual, but rather is in terms of 
specific skills. Conceptiially, the groups agree, but in prrcrice the dip-repancy is 
readily apparent. For example, while all three groups van ;: teach^er^s "Instructional 
skills," the exact skills valued might differ. We helv-ive that -*esolr*"kn would come 
through a shared discussion of goals, appropri /tO wdagogy, aud training activities. 

2) Provide training activities which are focused on sp^^eific content and skills, provide 
frequent measurements, and then provide feedbr^?:.^ Content is valued in the context of 
providing a foundation for assessing proWems, ideiitifying and examining 
alternative plans, and implementing plans From th\s p-irspoctive, we believe a bette 
integration of training activities is needed, not nscens^nly more training. 
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3) Assume greater responsibility for informing superintendents^ prmdi>alSy directors 
of special education, as well as teachers, of the trends and issues that have emerged and 
are emerging out of the conflicting notions between excellence/ reform and 
accountability for adidt adjustment outcomes for handicapped adcdescents. Teacher 
trainers need to initiate efforts to inform administrators, particularly, of the alarming 
post-school outcomes of handicapped students and of current alternatives in 
programming to address students' needs. 

Limitations 

In reviewing the outcomes of this survey, the outcomes were also understood in the context 
of several limitations. Central to those limiting factors was the low response rate, especially 
among superintendents of schools. Whether they did not respond due to a lack of perceived 
importance or of limited knowledge is unknown. However, if the issue is limited knowledge, 
special education support is likewise affected negatively. A superintendent, like almost 
anyone else, would have difficulty advocating a program which is not understood. We are 
reminded of the school superintendent who was encouraging patrons to support a bond issue for 
a larger school building. He was explaining several reasons for the bond issue to be supported, 
including that itinerant special education personnel working in a small pantry was violating 
the federal law to educate students in the "least restrictive environment!" This district's top 
administrator apparently had a mistaken notion of public law 94-142. Such misinformation 
does not bode well for a district's plans of establishing a defined mission and structure for 
sper^al education in the high school setting. 

Suminarv 

The Weighting Survey was completed by a sample of directors of special education, 
school superintendents, and pre-service teacher trainers. The survey elicited respondents' 
ranks and weights often attributes characteristic of a quality special education program and 
ten attributes of a quality special education staff. The three responding groups demonstrated 
very high agreements both in the assigned ranks and weights of the two sets of attributes. 
These consistencies were interpreted as indicating that the respondents had a similar model 
or frame of reference. The assigned weights suggested that special education programs were 
viewed with a pragmatic orientation. This orientation was characterized by emphasizing the 
importance of the teaching staff who should be familiar with individualizing instruction and 
skilled in planning and providing instruction. The outcomes of that instruction were viewed 
as contingent on the quality of the staff and as primarily staff directed rather than from 
district level or state level policies. In fact, special education programs and staff are not a 
single component, but rather each can reflect the diversity in the philosophy, goals, methods, 
activities, and content which characterizes current high school special education programs 
and secondary special education teacher training programs. 
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National Study 
of High School 
Programs for 
Handicapped 
Youth 



Gary M. Clnrk 
Principal hi iv^ii'^.Ui « i 

Don Dorscy 
Research Coordi natter 
r973/ S64-47S0 
(9i3 864-4954 

H. Earle Knoiclton 
Resen rch .4 <si\" itifc 
Oir^t S64-4954 

Daryl F. Mcllard 
Rcsca rch A >>i\ lj ic 
(9Ui 564-4 "SO 

Joanne R. Bod tier 
Research A<<i>tant 
(913) 864-4954 



April 17. 1987 



Dear Colleague 

Our project is one of many federally sponsored evaluation projects 
currently under way. Unlike other projects, however, our focus is 
national and on secondary level special education programs for 
mild to moderately handicapped students. More specSically, we 
are examining the characteristics of quality special education 
programs and teaching staff. Our point in writing you is to invite 
you to participate in this unique and important research project. 
Your view as well as the views of others in similar positions provide 
a national portrait of secondary level special education. Based on 
those collective judgments, reforms in special education might be 
more carefully targeted and resources more wisely expended. 

Within the next two weeks, we will initiate our data collection 
effort. We recognize that this letter is hardly personal and would 
prefer to gather our information through interviews. We also 
believe that you would be more inclined to allow us even 30 
minutes for an interview than spend 12 minutes on a survey. 
However, an interview is impractical for several reasons and 
instead we chose a survey procedure which you can complete in 
less than twelve minutes, and according to your time schedule. 
Your responses will be confidential. 

If for some reason you are unable to participate, return the 
enclosed postcard and we will remove your name from our mailing 
list. Of course, we would rather that you kept the postcard as a 
reminder of our project and hope that we dont hear from you until 
you have received our mailing and responded to our questions. A 
summary of our findings will be made available to you. If you have 
other questions, feel free to call us collect. 

Sincerely. 



Daryl F. Mellard 
Enc. 



Gary M. Clark 



The University of Kansas 
Department of 
Special Education 
377 Haworth Hall 
Uwrence, KS 66045-2330 
I Q (913) 864-4954 
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i'^ational Study 
.,f High School 
Programs for 
Handicapped 
Youth 



Gijry A/. Clark 

Don Dcrscu 
Rx-i.i ^ /; O \)r : r w ; • r 

li. Ltirlc kuo'u ltoii 
cpl^j ^:-4-49^4 

Pitryl /. Mclltini 



Dear Colleague, 



We wrote you two weeks ago and described our national evalua- 
tion project. As you may recall, our project is focusing on 
secondary level special education programs for students with 
mild to moderate handicaps. We are beginning our data collec- 
tion and inviting you to participate in this unique and impor- 
tant project, Is'e believe that the results will be valuable 
for improving special education programs and teaching staff at 
the local, state, and national levels. For example, you might 
use the results as a yardstick for how your program compares 
with other programs. 

One point which we would like to emphasize in our directions 
is that your responses reflect your special education program 
for students with mild to moderate handicaps rather than some 
image of an ideal program. Even though our request isn't very 
personal, we were thinking of you when we designed the task. 
For example, our task is likely easier and quicker than inter- 
viewing you. We believe that you can complete it within 
twelve minutes. We've enclosed a return envelope and pencil 
to expedite your responding. 

We are hesitant to mention this, but if for some reason you 
are not able to complete our task, we still want to l:now about 
you. If nothing else, please complete and return the last, 
section describing your professional background and program. 
Such information will help us to understand the limitations in 
our results, and to whom our results might apply. Feel 
assured that your responses will be confidential and reported 
only in group results. 



We want lu close with two other points. If you have further 
questions, please call us collect. We will be happy to answer 
them. Last, ho\.- about completing our task now? Considering 
the temptation to doing this later, we believe that it is 
likely easier, more efficient, and less time consuming for you 
to complete it now. 

Thank you for your efforts. 

Sincerely, 



Daryl F. Mcllard 



Gary M. Clark 



.'.e Universit\ of Kansas 
I )c pari men I of 
Spot ial I ducalion 
377 Hav\orth Hall 

avsrcncc, KS bfH)-l"^.21.^il 
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Weighting High School Special Education Program and Teacher 

AttributeF 



5 3 c k 2 r o u n Q 

We are asking you to rank and weight two sets of attributes. 
These attributes were selected by a panel of experts as most 
important when evaluating high school special education programs 
and teachers of students with mild to moderate handicaps. Based 
on your weighting, we'll know which of these attributes are most 
important. We have provided an illustrative example^ 



Example 

When a family was buying a car, there were five attributes 
on which they evaluated different cars: (a) miles per gallon, 



(b) purchase price, 
(e) comfort of ride, 
these five attributes 



(c) maintenance record, (d) color and 
The family members ranked and weighted 
as follows: 



Ranking Attribute Weighting 

4 Milespergallon 20 

1 Purchase price 120 

2 Maintenance record 45 

3 Color 20 

5 Comfort of ride 10 

The ranking listed in the left hand column established the 
relative importance of each attribute for deciding which car to 
purchase. Purchase price, ranked #1, was the most important^ 

The weighting values listed in the right hand column estab- 
lished how much more or less important each attribute was than 
the others. The attribute with the lowest rank is always 
weighted 10. Hence in this example, "comfort" was weighted 10. 

"Miles per gallon" was twice as important as "comfort," and 
thus was weighted 20 (2 X 10). While "color" was ranked as more 
important than "miles per gallon," both were weighted equally — 
20. Hence, both were twice as important as "comfort." Equal 
weights are permitted. 

"Maintenance record" was weighted 45, meaning it is 2.25 
times as important as "color" and "miles per gallon" (2.25 X 20) 
and 4.5 times as important as "comfort" (4.5 X 10). "Purcha^te 
price" was 12 times as important as "comfort" (12 X 10), six 
times "color" and "miles per gallon" (6 X 20), and 2.67 times 
"maintenance record" (2.67 X 45). 

In this example, the family knew which attributes to 
consider when evaluating different cars and the attributes' 
importance in making the final selection. 
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Weighting Program Attributes 

? ' • directions : o r R a n k i n :: 

A s s i ? n " r' 12 zhe c s i i : o r t 2 r. : a r : 
second most important attribute and sV on through 
the column labeled "Ranking 



r I D u I 



'Ranking, 
Ranking Program Attributes 
Effective staff 

Individualized, appropriate instruction 

Vocational/career orientation 

Administrative leadership and support 

Regular education support and integration 

Program support from staff, parents, 

business, and community 
Employment success 

Post-secondary transition curriculum 

Successful independent living 

Successful personal and social adjustment 



z J z ne 
"10" 



in 



Weighting 



Step 2 ; Directions for Weighting 

Beside the attribute which you ranked as 10th, write a 
10 in the column labeled "weighting." The numerical 
orl^^lW" choose for the other attributes should be 
greater than or equal to ten depending on your view of their 
importance The weights can be as large as you like and 
equal weights are permitted. ^iKe, ana 



Weighting Teacher Attributes 



Directions 



'l^'.^^i^ please rank and weight the following ten 

attributes by completing the same two steps as you did above 



Panking Teacher Attributes 



Weighting 



Instructional skills 

Assessment skills for planning and 

instruction 
Curriculum and instructional planning 

skills 

Working well with people 

Knowledge of transition 

Classroom organization skills 

Behavior management skills 

Working cooperatively with staff and 

administration 
Skill in assessing outcomes 
Incorporating vocational/career education 
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School Superintendents and Directors of Special Education 

Information 



Please check on' 



- am a school superintendent. 

director of special education. 

other. (Tell us. ) 



The region in which I work might be best characterized as: 

rural, isolated geographically and sparsely populated ^ 

rural, small town 

suburban 

urban ^ 

Please complete one of the following statements (a or b): 

a. What is the total enrollment in your school district? 

b. If your service area includes a number of school districts, such^ 
as in a special education cooperative or interlocal, what is the 
total enrollment of those school districts'? 



A. What was the last degree you earned? (Please check.) 

B.A./B.S. M.A./M.S. Ed, Spec. Ph.D./Ed.D. 

How many years have you been at the current district? 

^laber:'°''''' incorrect information on the attached mailing 



May 1?! m^rF:i5a;)r"Vhank^ru:^'°^^ '''^ --^^ - - 
and .III:: :riL'i^:,\r^;;:z^^^^ --^ 
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Weighting High School Special Education Program and Teacher 

Attributes 



•) a c .< u r c u n c 



We are asking you to rank and weight two sets of atf-' bu'-es 
These attributes were selected by a panel of experts a*s nTost 
important when evaluating high school special education programs 
and teachers of students with mild to moderate handicaps. Based 
on your weighting, we'll know which of these attributes are most 
important. We have provided an illustrative example. 

Example 

When a family was buying a car, there were five attributes 
on which they evaluated different cars: (a) miles per gallon, 
(b) purchase price, (c) maintenance record, (d) color and 
(e) comfort of ride. The family members ranked and weiahted 
these five attributes as follows: 

Ranking 

4 
1 
2 
3 
5 

The ranking listed in the left hand column established the 
relative importance of each attribute for deciding which car to 
purchase. Purchase price, ranked #1. was the most important 

l.-.hJn^t ''^^ehting values listed in the right hand column estab- 
lished how much more or less important each attribute was than 

attribute with the lowest rank is always 
weighted 10. Hence in this example, "comfort" was weighted 10.^ 

"Miles per gallon" was twice as important as "comfort " and 
thus was weighted 20 (2 X 10). While "color" was ranked aV more 
2S'"Hrnc/'H\ per gallon." both were weighted equally 

20. Hence, both were twice as important as "comfort." Equal 
weights are permitted. nquai 

"Maintenance record" was weighted 45. meaning it is 2 25 
times as important as "color" and "miles per gallon" (2 25 X 20) 
and 4.5 times as important as "comfort" (4.5 X 10). "Purchase 
price was 12 times as important as "comfort" (12 X 10) six 
times "color" and "miles per gallon" (6 X 20) . n h 9 A7 • 
"maintenance record" (2.67 X 45)! ^' ''^'"^^ 



Attribute 


Weightins 


Miles per gallon 


20 


Purchase price 


120 


Maintenance record 


45 


Color 


20 


Comfort of ride 


10 



to 



.on -H V, ^'^^"'Pl^' the family knew which attributes 

consider when evaluating different cars and the attributes' 
importance in making the final selection. attributes 
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Weighting Teacher Attributes 



: 3 n 1 n , 



Assign "V 10 I he mosc imporrani a~rribuie. "2" to the 
second most important attrr-bute and so on through "10" in 
the column labeled "Ranking/' 



Ranking Teacher Attribut es 



Weighting 



Instructional skills 

Assessment skills for planning and 

instruction 
Curriculum and instructional planning 

skills 

Working well with people 

Knowledge of transition 

Classroom organization skills 

Behavior management skills 

Working cooperatively with staff and 

administration 
Skill in assessing outcomes 
Incorporating vocational/career education 



Step 2: Directions for Weighting 

Beside the attribute which you ranked as 10th, write a 
"10" in the column labeled "weightings" The numerical 
weights you choose for the other attributes should be 
greater than or equal to ten depending on your view of their 
importance. The weights can be as large as you like, and 
equal weights are preraitted* 



Directions 

In this 
attributes by 



Weighting Program Attributes 



task, please rank and weight the following ten 
completing the same two steps as you did above. 



Ranking Program Attributes 



Weighting 



Effective staff 

Individualized, appropriate instruction 
Vocational/career orientation 
Administrative leadership and support 
Regular education support and integration 
Program support from staff, parents, 

business, and community 
Employment success 

Post-secondary transition curriculum 

Successful independent living 

Successful personal and social adjustment 
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School Superintendents and Directors of Special Education 

Information 

Please check one: 

I am a school superintendent. 

director of special education. 

other . (Tell us . ) 



The region in which I work might be best characterized as: 

rural, isolated geographically and sparsely populated 

rural, small town 

suburban 

urban 

Please complete one. of the following statements (a or b): 

a. What is the total enrollment in your school district? 

b. If your service area includes a number of school districts, such 
as in a special education cooperative or interlocal, what is the 
total enrollment of those school districts? 



4. What was the last degree you earned? (Please check.) 

B.A./B.S. M.A./M.S. Ed. Spec. Ph.D./Ed.D. 

5. How many years have you been *at the current district? 



^* ^label.''"''''^''' incorrect information on the attached mailing 



Mav 15^7q'ft7rp'-?%'"Tl°'l^ envelope and mail this survey to us by 
May L^, 1987 (Friday). Thank you. ^ 

and aJdrIss on^th/h''^' summary of our results, please write your name 
ana address on the back of the return envelope. 
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Weighting High School Special Education Program and Teacher 

Attributes 

Sacksrounc 

We are asking you to rank and weight cwo sets of attributes. 
These attributes were selected by a panel of experts as most 
important when evaluating high school special education programs 
and teachers of students with mild to moderate handicaps* Based 
on your weighting, we'll know which of these attributes are most 
important. We have provided an illustrative example. 

Example 



o n 



When a family was buying a car, there were five attributes 
which they evaluated different cars: (a) miles per gallon, 
(b) purchase price, (c) maintenance record, (d) color and 
(e) comfort of ride. The family members ranked and weighted 
these five attributes as follows: 

Ranking Attribute Weighting 



4 


Miles per gallon 


20 


1 


Purchase price 


120 


2 


Maintenance record 


45 


3 


Color 


20 


5 


Comfort of ride 


10 



The ranking listed in the left hand column established the 
relative importance of each attribute for deciding which car to 
purchase. Purchase price, ranked #1, was the most important. 

The weighting values listed in the right hand column estab- 
lished how much more or less important each attribute was than 
the others. The attribute with the lowest rank is always 
weighted 10. Hence in this example, "comfort" was weighted 10. 

"Miles per gallon" was twice as important as "comfort." and 
thus was weighted 20 (2 X 10). While "color" was ranked as more 
important than miles per gallon," both were weighted equally — 
20. Hence, both were twice as important as "comfort." Equal 
weights are permitted. 

"Maintenance record" was weighted 45, meaning it is 2.25 
times as important as "color" and "miles per gallon" (2.25 X 20) 
and 4.5 times as important as "comfort" (4.5 X 10). "Purchase 
price ^was 12 times as important as "comfort" (12 X 10), six 
times color and "miles per gallon" (6 X 20), and 2.67 times 
maintenance record" (2.67 X 45). 



In this example, the family knew which attributes to 
consider when evaluating different cars and the attributes' 
importance in making the final selection. 
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Step 1 : Direccions r o r R 



rC a n K i n 2 



Assign 1 ~o the mo si imporrani atiribuie, "l" no the 
second most important attribute and so on throuoh ''10" in 
the column labeled "Rankinq." 



Ranking Program Attributes 
Effective staff 

Individualized, appropriate instruction 

Vocational/ career orientation 

Administrative leadership and support 

Regular education support and integration 

Program support from staff, parents, 

business, and community 
Employment success 

Post-secondary transition curriculum 

Successful independent living 

Successful personal and social adjustment 



Weighting 



Step 2: Directions for Weighting 



iMnn ^.^^^^f attribute which you ranked as 10th, write a 

lU in the column labeled "weighting/' The numerical 
weights you choose for the other attributes should be 
greater than or equal to ten depending on your view of their 
importance. The weights can be as large as you like, and 
equal weights are permitted. 



Weighting Teacher Attributes 



Directions 



•i''. ^^l^ please rank and weight the following ten 

attributes by completing the same two steps as you did above. 



Ranking Teacher Attributes 



Weighting 



Instructional skills 

Assessment skills for planning and 

instruction 
Curriculum and instructional planning 

skills 

Working well with people 

Knowledge of transition 

Classroom organization skills 

Behavior management skills 

Working cooperatively with staff and 

administration 
Skill in assessing outcomes 
Incorporating vocational/career education 

page 2 of A 



ERIC 



1G4 



Teacher Trainers* Information 

Please in or check icems as appropriate, 

X . Respondeat cn^racieri sties 

1. What was the last degree you earned? (Please check.) 
B.A./B.S. M.A./M.S. Ed. Spec. Ph.D./Ed.D. 

2. What is/are your area(s) of specialization in special 

education? 

A. M.R. F. H.I. /Deaf K. Early Child. Hand. 

B. L.D. G. V.I. /Blind L. Diag . /Assess . 

C. B.D./E.D. H. Lang. /Comm. Dis. M. Career/Voc. Ed. 

D. SpEd. Ad. I. Phys. Hand. N. Generic/Cross Categ. 

^' Gifted J. Multiple Hand. 0. Other: 

3. If you checked more than one item above, write the letter that 

represents your primary area of specialization: 



^' check^one^^ ^^^^^ °^ ^P^^^^li^ation emphasis? (Please 

Early childhood Elementary Secondary Post-sec. 

5. What is your academic rank? (Please check.) 

Instructor Assist. Professor Associate Professor 

full Professor Other (Desciibe) 

6. How many years have you been at the current college/university? 



teaching administration research 

service other (Describe) 
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^rogram characteristics 

students i r. the c o 1 1 e g e / u r. i v e r s i t v 



2,500 


or less 


13,001 - 




25,001 


- 30,000 




2,501 


- 5,000 


15,001 - 


- 20,000 


30 ,001 


- 35,000 


• 


5,001 


- 10,000 


20,001 - 


- 25,000 


35,001 


or more 





9. Does your state have certification requirements for the secondarj 

level which are separate from the elementary level (i.e., K - 6" 

for teachers of students with mild to moderate handicaps? 4 

Yes No 



10. In the requirements at the secondary level for teachers of the 
mild to moderately handicapped, does your training prograir 
require student teaching or practica in a high school setting? € 



_Yes No 



11 



12 



Age level(s) for which you train special education teachers: 

_EarlyChildhood Elementary Secondary Po s t - s e condaP 

Including yourself, how many faculty members . (those with a rank 
of at least assistant professor) teach preservice courses speci- 
fically targeted for secondary level teachers of students with 
mild to moderate handicaps? 



13. 



14, 



"^nf V^Vt p^n' ^" participating in a special interest group 

of the CEC-TED focusing on secondary and post-secondary teacher 
trainers.' 

Yes No 

€ 

^iabel' "''''^''^ incorrect information on the attached mailing 



Mav 15^^1lR7"rF envelope and return this survey to us by 

May 15, 1987 (Friday). Thank you. ^ 

If you would like a summary of our results, please write your name 
and address on the back of the return envelope. 
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Weighting High School Special Education Program and Teacher 

Attributes 



r^acKerounQ 

We are asking you to rank and weight two sets of attributes. 
These attributes were selected by a panel of experts as most 
important when evaluating high school special education programs 
and teachers of students with mild to moderate handicaps. Based 
on your weighting, we'll know which of these attributes are most 
important. We have provided an illustrative example. 

Example 

When a family was buying a car, there were five attributes 
on which they evalu.'.ted different cars: (a) miles per gallon, 
(b) purchase price, ^c) maintenance record, (d) color and 
(e) comfort of ride. The family members ranked and weighted 
these five attributes as follows: 

Ranking Attribute Weighting 

4 Miles per gallon 20 

1 Purchase price 120 

2 Maintenance record 45 

3 Color 20 

5 Comfort of ride 10 

The ranking listed in the left hand column established the 
relative importance of each attribute for deciding which car to 
purchase. Purchase price, ranked #1, was the most important. 

The weighting values listed in the right hand column estab- 
lished how much more or less important each attribute was than 
the others. The attribute with the lowest rank is always 
weighted 10. Hence in this example, "comfort" was weighted 10. 

"Miles per gallon" was twice as important as "comfort," and 
thus was weighted 20 (2 X 10). While "color" was ranked as more 
important than "miles per gallon," both were weighted equally — 
20. Hence, both were twice as important as "comfort." Equal 
weights are permitted. 

"Maintenance record" was weighted 45, meaning it is 2.25 
times as important as "color" and "miles per gallon" (2.25 X 20) 
and 4.5 times as important as "comfort" (4.5 X 10). "Purchase 
price" was 12 times as important as "comfort" (12 X 10), six 
times "color" and "miles per gallon" (6 X 20), and 2.67 times 
''maintenance record" (2.67 X 45). 

In this example, the family knew which attributes to 
consider when evaluating different cars and the attributes' 
importance in making the final selection. 
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Weighting Teacher Attributes 

Step 1 : Directions for Rankin 

Assign "1" to the most iTiportant attribute, "2" to the 
second most important attribute and so on through "10" in 
the column labeled "Ranking." 

Ranking Teacher Attributes Weighting 
Instructional skills 

Assessment skills for planning and 

instruction 

Curriculum and instructional planning 

skills 

Working well with people 

Knowledge of transition 

Classroom organization skills 

Behavior management skills 

Working cooperatively with staff and '^^^^^^ 

administration 

Skill in assessing outcomes 

Incorporating vocational/career education 



Step 2 : Directions for Weighting 

Beside the attribute which you ranked as 10th, write a 
"10" in the column labeled "weighting." The numerical 
weights you choose for the other attributes should be 
greater than or equal to ten depending on your view of their 
importance. The weights can be as large as you like, and 
equal weights are permitted. 



Weighting Program Attributes 



Directions 



In this task, please rank and weight the following ten 

attributes by completing the same two steps as you did above. 

Ranking Program Attributes Weighting 

Effective staff 

Individualized, appropriate instruction ^^^ZZ 

Vocational /career orientation 

Administrative leadership and support 

Regular education support and integration Z^^ZI 

Program support from staff, parents, 

business, and community 
Employment success 

Post-secondary transition curriculum 

Successful independent living 

Successful personal and social adjustment 
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Teacher Trainers* Information 

Please fill in or check iiems as :ipprDpriatG. 
A. Respondent characterirstics 

K What was the last degree you earned? (Please check.) 
B.A./B.S. M.A./M.S, Ed. Spec. Ph.D./Ed.D. 



2. What is/are 
education? 



your area(s) of specialization in special 



A, 

B, 
C, 



_L.D. 

_B.D./E.D. 
^SpEd . Ad . 
Gifted 



H, 
I , 
J, 



_H.I ./Deaf K. 

J.I./Blind L. 

_^Lang . /Comm , Dis . M . 

_^Phys. Hand. N. 

^Multiple Hand . 0. 



_Early Child. Hand. 
_Diag. /Assess. 
^Career/Voc. Ed. 
^Generic/ Cross Categ< 
Other : 



3. If you checked more than one item above, write the letter that 
represents your primary area of specialization: 



What is the age level of your specialization emphasis? (Please 
check one.) 



^Early childhood 



^Elementary 



^Secondary 



Post-sec . 



5. What is your academic rank? (Please check.) 

Instructor Assist. Professor Associate Professor 

Full Professor Other (Describe) 

6. How many years have you been at the current college/university? 



7. Please record the percentages of time you give to each area 
(Total equals 100%.) 



^teaching 
service 



_^administration 
_other (Describe) 



research 
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Program characteristics 

3 . X u m b e r of students in the c c 1 1 5 5 e .-' 'j n i v s r s i t v : 

-.500 or less iO.OCi - 15,000 25,001 - 30,000 ^ 

2.501 - 5,000 15.001 - 20,000 30,001 - 35,000 

5.001 - 10,000 20.001 - 25.000 35,001 or more 

9. Does your state have certification requirements for the secondary 
level which are separate from the elementary level (i.e.. K - 6) 
for teachers of students with mild to moderate handicaps? 



Yes No 



10, 



In the requirements at the secondary level for teachers of th^ 
mild to moderately handicapped, does your training program 
require student teaching or practica in a high school setting? 



Yes No 



11. Age level(s) for which you train special education teachers: i 
EarlyChildhood Elementary Secondary P o s t - s e c ondar; 

12. Including yourself, how many faculty members (those with a rank 
of at least assistant professor) teach preservice courses speci- 
fically targeted for secondary level teachers of students wit» 
mild to moderate handicaps? 



13. Are you interested in participating in a special interest group 

ot the LtL-IbD focusing on secondary and post-secondary teacher 
trainers? ^ 
Yes No 

14. Please correct any incorrect information on the attached mailing 

label : " 



M^v l^S^^l^ftv""?? envelope and return this survey to us by 

May 15, 1987 (Friday). Thank you. 

If you would like a summary of our results, please write your 
and address on the back of the return envelope. 



name 
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Survey 4: Implementation Survey of Hi^ School 
Special Education Program Activities 



" Overview 

For most students with mild to moderate handicaps, the high school experience 
culminates their formal educational program. Thus, these educational experiences are very 
important to the students' futures and to their participation in the larger society as 
knowledgeable citizens, wage earners, and members and transmitters of the American 
culture. Given these important functions, an understanding of the goals of special educational 
programs and those of the larger educational setting, the high school, provides a framework in 
which students* cumulative experiences might be understood. We know several facts about 
these cumulative school experiences. For instance, we know that the regular high school 
program exists to qualify students to satisfy the various societal functions outlined above. 
Second, we know that the special education programs for mild to moderate students exist to 
respond to a variety of perceived student needs. Students participating in these programs have 
qualified for this participation through their documented learning and achievement 
differences from the mainstream of the high school population. We also recognize that these 
educational programs are developed and directed by a number of divergent elements and 
competing priorities (Bodner et al., 1987). Some influencing elements include the divergence 
of the population's characteristics, the reforms in regiilar education, the emphasis on 
transition services, the desired integration of regular and special education, and the training 
programs for instructional staff. 

This diversity of priorities and influences helped to focus the objective of this research. 
The objective for this research project arose from the need among high school special education 
students with mild to moderate handicaps for a coordinated transition from the structured 
environment of school to the independent world of adulthood and employment. To achieve this 
coordinated transition, the research staff chose to examine high school special education 
programs and pre-service special education teacher training programs as currently 
implemented. Neither the goals of these programs nor their included activities have been 
documented in a national database. The National High School Project involved three 
research efforts, Bodner et al. (1987), Knowlton and Clark (1989), as well as the research 
described here. These efforts provide integrated, multiple perspectives on high schools' efforts 
to ensure the successful transition of students with mild to moderate handicaps to independent 
functioning in the community. 

In this NHS research project, five surveys of directors of special education, 
superintendents of schools and pre-service teacher trainers were completed. Each survey was 
a step in completing the multi-attribute utility measurement procedure (MAUM) (Edwards, 
1977). MAUM procedures provide a means for identifying goals and examining how well a set 
of options satisfy those goals. In this effort, the goals were conceptualized as desired attributes 
of special ediication programs and teaching staffs. The options were considered as the 
activities which take place in high school special education programs for students with mild to 
moderate handicaps or the pre-service training programs for teachers in those programs. The 
question addressed through these procedures was "Which of the activities are most likely to 
contribute to the goals?" As stated previously, and evidenced in responses to the Elicitation 
Survey, the goals represented a heterogeneous variety. Yet, these divergent goals represent the 
exact situation confronted by policy makers, administrators, and practitioners in the course of 
day-to-day educational planning and instruction. That is, these individuals must seek to 
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balance and meet a multifaceted set of educational goals advocated by a diverse public. 
Concurrently, they must complete this task through defined educational activities. An 
example of an apparent conflict is that students in special education programs are required to 
have an individual educational program, a course of studies specifically based on their 
unique strengths and weaknesses. The conflict becomes apparent when the district uses a 
standardized measure of achievement to assess the student's progress, to evaluate the 
effectiveness of the special education program, or to evaluate the district against a set of 
externally defined goals. In those cases, the assessment is unlikely to have included material 
which was specifically targeted for these students in special education programs. In such 
instances the accountability or effectiveness question is not adequately addressed, because the 
test's content was not based upon the student's curriculum or the teacher's instruction. 

Just as responses to the Elicitation Survey noted a variety of goals, the responses also 
indicated that activities included in current high school special education programs vary 
widely, from basic skills instruction and driver education instruction to work study programs 
and vocational assessment. From this plethora of program activities, twenty-eight were 
categorized from responses on the Elicitation Survey. As the goals of the special education 
program were examined through two subsequent surveys, the Ranking Survey and the 
Weighting Survey, the data would seem to indicate that the respondents were much more 
comfortable in identifying quality programs in terms which described or characterized the 
programs themselves than what might be indicated by students' performance in a defined 
school curriculum or in their post-school adjustment as citizens, workers, or cultural 
members. 

Given that quality programs are characterized primarily by a mixture of program 
descriptors as well as students' outcomes, the question remains, which activities foster these 
goals? That is, which of the various instructional activities are judged by directors of special 
education, superintendents of schools, and pre-service teacher trainers as best enhancing the 
divergent goals? A necessary assumption to this research project was tTiat the activities 
included in high school special education programs were included to develop, enhance, or 
otherwise influence the attributes or goals of the programs. However, the remaining question 
was determining the extent to which the program's activities contributed to attributes of 
successful special education programs. Survey 4, the Implementation Survey, was intended to 
provide information establishing that link. In this manner, the researchers hoped that the 
findings would be useful in the selection and implementation of activities for special 
education programs designed for secondary school students with mild to moderate handicaps. 
That is, given an agreed upon set of goals, the activities which best fostered those goals could be 
identified and recommended for implementation. 

Methodological Considerations 

The major methodological problem confronted in Survey 4 concerned the need for 
reliable and accurate judgments from the respondents. The MAUM methodology required 
respondents to indicate the extent to which a particular activity, e.g., "Individualized 
instruction," supported or contributed to a desired goal of the program, e.g., "Regular 
education support and integration." The complicating factor was that on the first survey, the 
Elicitation Survey, over 28 activities had been identified. Thus, if each respondent were to 
evaluate the 28 activities for each of the ten program goals derived from Survey 2, the 
respondent would make 280 ratings (28 activities x 10 goals = 280 utility measurements). This 
number of ratings was not considered reasonable, particularly in light of the low response 
rates by superintendents of schools in previous surveys. Project staff considered the number 
as likely to contribute to a very low response rate. In addition, the number would fatigue even 
the most diligent respondents who chose to participate. 
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As an alternative to 280 measurements for each respondent, the decision was made to use 
a matrix sampling procedure. In this matrix sampling procedure, each respondent received a 
unique survey which contained all ten of the program attributes and a subset of seven activities 
from the 28 activities for each attribute. This item sampling plan allowed each respondent to 
examine program activities in light of each of the top ten program attributes. Further 
discussion of the sampling procedure and the instrumentation is provided in the procedures 
section of this report. 

The second methodological issue concerned possible order effects in the respondents' 
answers. In theory, the answers from one item to the next item were independent. As one 
means to ensure this goal, the survey items were randomly ordered for each survey. This 
randomization procedure produced, in effect, a unique form for each survey. Thus, if an order 
effect was likely, each survey's content was altered such that the activities and attributes were 
presented in varied ordinal positions. 

The surveys completed in this effort of the National High Schv 1 project were designed to 
establish a database of special education directors', school superintendents', and pre-service 
teacher trainers' perspectives on the qualities of special education programs and their 
teaching staffs for students with mild to moderate handicaps. In this fourth survey, the purpose 
was to examine the relationship between existing special education programs' desired 
attributes and the activities which occur within those programs. That is, from the respondents' 
perspectives, how well do the program activities facilitate the accomplishment of identified 
priorities? The following section describes the methodology to address this question. 



Method 



The results of the previous surveys (Survey 1, the Elicitation Survey; Survey 2, the 
Ranking Survey; and Survey 3, the Weighting Survey) were prerequisites for the 
Implementation Survey. The Elicitation Survey (Survey 1) was designed for Directors of 
Special Education (DOSE), Superintendents of Schools (SOS), and Pre-service Teacher 
Trainers (PTT) at institutions of higher education to identify the attributes and activities of 
successful special education programs for students with mild to moderate handicaps, 
((^oncurrently, they identified the desired attributes of special education instructional staffs in 
high school settings and the training activities which enhanced those attributes. The 
relationship between the staff attributes and the pre-service training activities is presented in 
Survey 5.) On the Ranking Survey (Survey 2), the top ten attributes of special education 
programs and staff were chosen by sixteen professionals in the education field. Next, DOSE, 
SOS, and PTT responses on the Weighting Survey (Survey 3) established mean normative 
weights for the top ten attributes of special education programs and the top ten attributes of 
special education teachers. These mean values were entered in a database for subsequent 
analyses on the results from this survey, the Implementation Survey. 

The Implementation Surveys (Surveys 4 and 5) involved multi-attribute utility 
measurement (Edwards, 1977) procedures, the fourth major phase of this research project. 
Formally, this step in utility measurement is referred to as a location measure. "Location" 
refers to the degree to which a particular activity contributes to a specific program attribute. 
Location conveys the meaning that the different activities likely would have degrees of 
contribution to make and thus would be located differently from one attribute to another 
attribute on a rating or comparison continuum. This section details the Implementation 
Survey sent to DOSE and SOS regarding the various activities in high school special education 
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programs for students with mild to moderate handicaps. The survey procedures were designed 
to address the question: Which of the high school activities contributed most to the defined 
program attributes? 

Subjects 

The advance letter sent in the week of April 17, 1987 for Survey 3 (Weighting Survey) also 
determined the subjects for the Implementation Surveys. The advance letter (see Appendix G 
of Survey 3) , along with a post-paid card to be returned in case the subject could not participate 
in the survey, was sent to 800 DOSE and 900 SOS. One hundred seventy-one postcards were 
returned and those subjects were subsequently deleted from the database. 

From the remaining database records, 650 DOSE and 750 SOS were randomly selected 
for both the Weighting and the Implementation Surveys. During the week of May 1, 1987, 450 
SOS and 400 DOSE were sent the Implementation Survey on activities implemented in special 
education programs. 

Materials 

The materials are described in terms of a general description of the Implementation 
Survey, which had two versions, and a description of the two sections which made up each 
survey version: (1) the background information section and the (2) multi-attribute utility 
measurement procedure section. 

General description of survev . Two versions of the Implementation Survey were 
developed, one for the (1) DOSE and SOS groups and another for the (2) PTT group. The DOSE 
and SOS version was employed in the utility measurements of high school special education 
program activities, discussed in this section of the report. The PTT Implementation Survey 
sent to pre-service teacher trainers at institutions of higher education is discussed separately 
as Survey 5: Implementation Survey of Pre-service Special Education Teacher Training 
Activities. 

The Implementation Survey consisted of two sections. The principal document of the 
survey consisted often items, the ten program attributes, for the multi-attribute utility 
measurements procedure. The second part consisted of pages eliciting background 
information about the participant. 

Construction MAUM jSficfcioii. A Pascal computer program (see Appendix J) was used 
for generating the surveys so that both program attributes and program activities could be 
randomly ordered in all the survey forms. 

The main body of the survey document (see Appendix K) sent to DOSE (n = 400) and SOS 
(n = 450) was composed often attribute items. Each item corresponded to a separate program 
attribute ranked among the top ten by professionals who participated in the Ranking Survey 
(Survey 2). A sample item is presented in Figure 2. In this example, two program attributes 
are presented; for each attribute, seven activities are listed. The respondent was asked tc 
mark one of the choices (NA, 1, 2, 3, 4, 5, or 6) to the right of the activity listed, according to the 
respondent's perception of how effectively the given actvity developed, cultivated or 
influenced the attribute designated by each item. If the activity was not part of the respondent's 
particular special education program, then s/he assigned a value of "NA" (not applicable), to 
the activity. ' 

The ten highest-ranked attributes of successful special education programs identified in 
Survey 2, the Ranking Survey, were randomly ordered for each Implementation Survey form. 
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For each of the ten attributes, seven program activities were randomly selected from the set of 
28 that were categorized in Survey 1, the Elicitation Survey. These seven program activities 
were randomly selected without replacement and randomly ordered for each survey prepared. 
Hence, each survey was a unique form due to the process of random selection (of program 
activities) and random ordering (of program attributes and program activities) in generating 
the survey items. Consideration was given to how many of the 28 activities should be presented 
with each of the ten attributes. Ty,'o values were considered. The first value was the likelihood 
of a survey being completed and returned. The second value was the number of responses 
deemed necessary to ensure a stable measurement of the variable. In balancing these two 
values, seven was chosen as an appropriate number of activities to include with each attribute. 
Thus, the respondent was asked to make seventy judgments (7 activities X 10 attributes). For 
the total sample, approximately 30 responses were expected for each of the program activities as 
paired with the program attributes. Hence, through the matrix sampling plan, unique 
individual surveys were constructed to provide a reliable measure of the respondent's view on 
the relationship of the ten program attributes and randomly selected program activities. 

Respondents were asked to assign a value ranging from one (low) through six (high) to 
seven special education program activities listed with each program attribute. The 
respondents were asked to choose a value based on the degree to which the program activity 
contributed, developed, or otherwise influenced the particular attribute. If the activity was not 
part of the respondent's particular high school special education program, then the respondent 
assigned a value of seven, meaning "not applicable" to the program activity. 

Constructipn fif ba ckground i nfonnation ^ggtiOII. The first page of the Implementation 
Survey for the DOSE and SOS was designed to elicit background information regarding the 
survey participants. Respondents were asked to signify their employment position, their 
school district setting and enrollment size, their most recent degree earned, and their years at 
the current district. Both DOSE and SOS received identical background-information forms. 
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Survey Procedure 



This section describes the process that generated the survey document, then the survey 
process, from mailing, to the returns, to the coding of responses, and through the data analyses 
on the participants* responses. 

Pilot test Prior to disseminating the surveys, two pilot studies were conducted. In the 
first pilot study, six graduate students at the Institute for Research in Learning Disabilities at 
the University of Kansas participated. On February 18, 1987, six doctoral students in special 
education completed a draft edition of the Implementation Survey. 

The second pilot study was conducted in a graduate level research design class at the 
University of Kansas. In February, 1987, class members were asked to participate in a multi- 
attribute utility measurement procedure by designating a value between one through s>'x to the 
impact of special education program activities on successful special education programs. 
Following the students' completion of the task, a discussion followed which focused on the 
instrument and procedures. Recommendations and clarifications resulting from the pilot 
studies were incorporated into the final version used in Survey 4. 

Survey mailing. Two weeks after the April 17, 1987 advance mailing, the 
Implementation Survey forms were mailed, on the week of May 1, 1987; 450 were mailed to SOS 
and 400 to DOSE. The mailing included a letter of explanation, the survey itself, a postage- 
paid return envelope, and a pencil to facilitate the respondent's reply. 

Survey returns. Table 31 shows the mailing targets for the Implementation Survey as 
well as the number and percentage of survey forms returned by the respondents for the DOSE 
and SOS. 



Table 31 

Mailing XaigatS ami Respondents for the Imnlementation Survftv for DOSE flnfl pog 



Number of surveys Directors Superintendents 



Mailed 400 450 

Returned usable 155 108 

Returned unusable 21 43 

Total returned "^76 151 

(Percent) (44%) (34%) 
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Data coding. As the surveys were returned in the mail, each survey was given an 
identification number for tracking purposes. Sixty-four returned surveys were found 
unusable for reasons varying from that a person other than the targeted administrator 
responded to the items, to returns so delayed that the data analyses were completed before their 
arrival. Efforts were exerted to include survey responses whenever possible. For example, 
when someone other than the targeted administrator responded to the survey, if the 
respondent's position corresponded to the intended respondent (e.g., an assistant 
superintendent for a SOS or a SPED coordinator for a DOSE), then the return was deemed 
usable. Those surveys that were returned and found usable were coded for data entry and 
entered into a database for analyses. 

In the analyses, the data of interest were the utility measurements assigned to the 
program activities. The utility measurement is a numerical value which combines the 
numerical weighting of a given attribute with the numerical value of the location measure. In 
this project, each of the ten top program attributes were weighted by groups of DOSE and SOS. 
These weights were the results reported in the Weighting Survey (Survey 3). The location 
measures were the values between one (low) and six (high) which were obtained in this survey 
for DOSE and SOS. The location measure represents the extent to which a particular program 
activity contributed, developed, or influenced a program attribute. A low value indicated that 
the activity made little contribution, while a high value indicated that the activity made a 
major contribution to a program attribute. Thus, the utility measurement reflected the 
importance that the respondents attached to particular program activities as a means of 
realizing program attributes. The program activity with the highest numerical value can be 
considered as the activity which has the greatest utility or value in meeting the desired 
program attributes. 

In computing the utility measurements for the program attributes, a database was made 
which might be conceptualized as a matrix of rows and columns. A matrix was developed for 
each respondent. The matrix's columns represented each of the program attributes with its 
calculated mean weight (obtained from Survey 3, the Weighting Survey, respondents). These 
weights were calculated for the two groups separately. Thus, in calculating the utility 
measurements, the weighting assigned to the program attributes depended on each 
respondent's group membership, either DOSE or SOS. The matrix's rows represented the 
program activities. The individual cells included the product of multiplying a program 
attribute's weight by the location measure assigned by the respondent, a value from one to six. 
The utilities were summed across all of the attributes (columns) to determine the overall utility 
of a given activity. 

Once these computations were completed for each respondent, the results were summed 
across all the respondents within the group, DOSE and SOS. These sums were the utilities for 
each of the program activities. However, since the magnitude of the sum depended in part on 
the number of respondents, statistical analyses were required before further interpretations 
could be completed. 

Data analyses. Statistical indices were calculated on the utility measurements of the 
program activities. In other words, the dependent variables were the 28 program activities and 
the independent variable was the responding group, either DOSE or SOS. These statistics 
included descriptive statistics for the two responding groups - means, standard deviations, 
and confidence intervals - and inferential statistics for comparing the two groups - 
multivariate tests of significance, univariate F-tests, and univariate homogeneity of variance 
tests. The outcomes of these calculations are described in the Results section. 
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Results 



Completed, usable surveys were coded and included in the statistical analyses. The 
results of the statistical procedures are described in this section. Initially, descriptive statistics 
were computed which were then followed by comparisons between the responding groups using 
multivariate analysis of variance techniques. 

Descriptive Statistics 

Table 32 shows the mean, standard deviation, and 95% confidence interval for each 
special education program activity for the DOSE and SOS. The program activities are listed 
with their mean values, from highest ("Inclusion in regular school activities," 125.2) to lowest 
("Fine arts instruction," 56.3). These mean scores may be interpreted as the numerical 
values of DOSE'S and SOS's responses to the query: Which special education program 
activities best foster, contribute, or develop the ten highest-ranked special education program 
attributes? Recall that the ten program attributes were selected from a larger set which had 
been rank ordered and weighted to reflect their importance for a quality special education 
program (see Surveys 2 and 3). 

Doubling and then adding and subtracting the standard error of the mean offers the 
upper and lower limits at which the mean will be found 95 percent of the time. Thus, the 95% 
confidence interval for "Inclusion in regular school activities" was from 113.9 through 136.5. 
As with this project's previous surveys, the directors of special education were the primary 
reference group and their calculated values are listed in Table 32's first column. 

The means and the standard deviations tended to correspond in that as the mean values 
decreased, the standard deviations also lessened so that "Fine arts instruction," which had the 
lowest mean utility value for the DOSE (56.3) also had the smallest deviation (50.62). Thus, the 
respondents had the greatest agreement among the activities which had the least utility. The 
program activity with the highest mean (Inclusion in regular school activities, with a mean of 
125.2 and standard deviation of 71.2) did not have the most variance. "Individualized 
instruction," ranked second in mean value (125.1), had the largest standard deviation (77.7). 
However, the general pattern of variance estimates to mean values generally held. The 
higher the mean, the greater the dispersion of scores and the lower the mean value, the less 
dispersion evidenced among the scores. 

Another index of the degree of overlap between the two groups' judgments was reflected by 
calculating the Spearman rho correlation among the rankings of the assigned mean values. 
The calculated correlation was .896. This value indicates a very high positive correlation 
among the DOSE's and SOS's ratings of the program activities. 
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Multivariate Tests of Significance 

Results of the Pillais, Hotellings, and Wilks multivariate tests of significance are 
shown in Table 33. These tests simultaneously tested the utility value means of the twenty- 
eight program activities of the DOSE and the SOS for statistically significant differences. A 
probability value of .05 or less was considered significant. Each test indicated an overall 
significant difference among the directors' and superintendents' utility measures of the 
program activities. 



Table 33 

Multivariate Tests of Significance for Special Education Program Activities (S = 1 ^ M = -^i 

n=ii6) 





Test Name 


Value 


Exact F 


Hypoth. DF 


Error DF 


p value 


• 


Pillais 


.20467 


2.15061 


28.00 


234.00 


.001 




Hotellings 


.25734 


2.15061 


28.00 


234.00 


.001 




Wilks 


.79533 


2.15061 


28.00 


234.00 


.001 



ate F- tests 

Univariate F-tests were completed as post hoe measures and performed after the 
multivariate tests indicated significant p values for the overall test of group means. The 
univariate F-tests examined the equality of group means for each activity separately. Ap 
value of .05 or less signified that the DOSE and SOS assigned significantly different utility 
measurements to that particular program activity. As shown on Table 34, four program 
activities ("Physical education instruction," "Inclusion in mainstream classes," "Speech 
and communications instruction," and "Fine Arts instruction") as well as the Total for the 
twenty-eight activities had significantly different mean values for th^ DOSE and the SOS. In 
each instance the SOS assigned greater utility than did the DOSE to these four activities, which 
is reflected in the larger mean values. From the SOS perspective then, these activities have 
greater value in realizing for their district the ten attributes identified with successful high 
school special education programs. The interpretation of these values is that the districts' 
superintendents of schools believed that these four activities contributed more to the special 
education programs' achievement of the desired attributes than did the local directors of 
special education. An interesting aspect about this list of four activities was that "Inclusion in 
mainstream classes" was the only activity which had a specific link to the special education 
program. That is, "mainstreaming" is a term associated with special education and reflects a 
particular philosophical perspective about service delivery. The other three activities are not 
unique to special education. 
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Table 34 

Univariate F-tests with fl and 261) Degrees of FrftftHnm 



Program activity 


Hypoth. MS 


Error MS 


F 


p value 


Basic skills instruction 


7899.00 


4837.77 


1.63 


.202 


rhysical education instruction 


22622.37 


2926.21 


7.73 


.006* 


Independent living skills instruction 


243.32 


4033.40 


.06 


.806 


Driver education instruction 


52.13 


3914.11 


.01 


.908 


Regular & adapted vocational education 


7174..24 


5603.26 


1.28 


.259 


Pre-vocational & career education 


6252.89 


4663.61 


1.34 


.248 


Work study program 


448.11 


5301.99 


.08 


.771 


Social skills instruction 


4600.15 


4423.32 


1.04 


.309 


Guidance & counseling services 


7803.22 


4962.84 


1.57 


.211 


Learning strategies instruction 


1114.21 


4539.74 


.25 


.621 


Academic assistance tor mainstream classes 15872.58 


5067.68 


3.13 


.078 


Inclusion in regular school activities 


4918.90 


5421.09 


.91 


.342 


Inclusion in mainstream classes 


18035.60 


4023.93 


4.48 


.035* 


Individualized instruction 


413.13 


6037.99 


.07 


.794 


Peer tutoring & peer counseling 


1349.46 


3753.84 


.35 


.549 


Functional academics instruction 


551.36 


4721.04 


.11 


.733 



(table continues) 
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Table 34 continued 



Program activity 


Hj'poth. MS 


Error MS 


F 


n vji 1 n A 
value 


Vocational assessment 


456.67 


3929.98 


.11 


.733 


Community-based instruction 


3992.44 


2774.24 


1.44 


.231 


Transition planning 


515.59 


3550.58 


.15 


.703 


Speech & communications instruction 


33305.17 


2916.09 


11.42 


.001* 


Computer assisted instruct & training 


8277.27 


2774.88 


2.98 


.085 


Hands-on materials & activities 


5747.75 


4546.05 


1.26 


.262 


Fine arts instruction 


19754.58 


2808.81 


7.03 


.008* 


Work adjustment & work activities 


1484.62 


4147.11 


.36 


.550 


Job placement program 


9955.61 


4266.61 


2.33 


.128 


Behavior modification plans 


8874.23 


3294.33 


2.69 


.102 


Parent & employer involvement 


893.88 


4395.42 


.20 


.652 


Assessment plan 


6488.58 


3474.35 


1.87 


.173 


Total Activities 


7110.61 


4182.50 


1.70 


.012* 



Note. *p value = < .05 

Univariate Homogenpity of Variance Tf^ptS 

As shown in Table 35, three program activities have calculated p values of .05 or less in 
the univariate homogeneity of variance tests. These significant values indicate that for the 
"Hands-on materials and activities," "Job placement program," and "Behavior modification 
plans," the calculated varirinces between the DOSE and SOS were reliably different. One of 
the assumptions of the univariate tests is that the variances are equal between the compared 
populations. The results of these homogr.neity tests imply that three of the activities had 
variances which were not comparable. Despite these violations of one assumption, 
statisticians have demonstrated and accepted such findings as robust. 
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Table 35 

Univariate Homogeneity of Variance Tests for Special Education Program Activities 



Bartlett-Box 

Program activity F (1,187254) p value 



Basic skills instruction 


.00617 


1.000 


Physical education instruction 


.00293 


1.000 


Independent living skills instruction 


.01229 


1.000 


Driver's education instruction 


.43982 


.507 


Regular & adapted vocational education 


1.36571 


.243 


Pre-vocational & career education 


.05501 


1.000 


Work study program 


.07640 


1.000 


Social skills instruction 


.07743 


1.000 


Guidance & counseling services 


.28283 


.595 


Learning strategies instruction 


.31684 


.574 


Academic assistance for mainstream classes 


3.23885 


.072 


Inclusion in regular school activities 


.75201 


.386 


Inclusion in mainstream classes 


3.08992 


.079 


Individualized instruction 


.00000 


1.000 


Peer tutoring & peer counseling 


.33676 


.562 


Functional academic instruction 


1.32450 


.250 


Vocational assessment 


1 .54396 


.214 


Community-based instruction 


.02656 


i.OOO 


Transition planning 


.36353 


.547 


Speech & communications instruction 


.69450 


.405 



(table continues) 
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Table 35 continued 



Program activity 


Bartlett-Box F 
(1,187254) 


p value 


Computer assisted instruction & training 


.80790 


.369 


Hands-on materials and activities 


6.45756 


.011* 


Fine arts instruction 


1.99005 


.158 


Work adjustment & work activities 


.30113 


.583 


Job placement program 


4.23394 


.040* 


Behavior modification plans 


4.35664 


.037* 


Parent and employer involvement 


3.06917 


.080 


Assessment Plan 


.08225 


1.000 



Note. *p value = < .05 



Discussion 



The fourth phase of the research project focused on DOSE and SOS implementation 
perspectives on the utility of program activities' impact on special education program 
attnbutes. This section of the report briefly reviews the survey procedure; enumerates the 
projects hmitations of sample size, return rate, and instrumentation; summarizes the 
findings and infers conclusions; and indicates directions for further study. 

The three previous surveys (Elicitation, Ranking, and Weighting) dealt with the 
Identification and ranking in importance of the desirable attributes of special education 
programs. The Elicitation Survey (Sui/ey 1) resulted in categorizations of 40 special 
education program attributes, 28 special education program activities, 23 special education 
teacher attributes and 18 pre-ser\'ice teacher training activities; however, the listings were not 
ranked. The Ranking Survey (Survey 2) involved 16 professionals who ranked the 40 special 
education program attributes and 23 special education teacher attributes. The two sets often 
highest-ranked attributes from the Ranking Survey were listed in the Weighting Survey 
(Survey 3), in which DOSE, SOS and PTT weighted the program attributes and teacher 
attributes. 



As the final step in the establishment of utility measures for special education program 
actmties, the Implementation Survey for DOSE and SOS made it possible to list a ranking of 
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activities as they enhance or somehow influence the desirable attributes of special education 
programs. Hence, the results of this fourth survey could not be compared with those of the 
previous surveys, since the focus shifted, from identifying and ranking the attributes of 
quality special education programs, to the degree of influence that special education program 
activities have upon the program attributes. The importance of this implementation survey is 
to develop an understanding of how the respondents, DOSE and SOS, evaluate the variety of 
activities that are included in high school special education programs for students with mild to 
moderate handicaps. For example, if a districts preeminent goal was to improve the students' 
reading scores, any activities which were not reading related would havttlittle utility for 
accomplishing this goal. In the framework of this project, the goal, "improving students 
reading" might be thought of as an attribute of a quality high school special education 
program. The question addressed in this fourth survey was to establish the DOSE's and SOS's 
ratings on how well a variety of special education program activities contributed to ten highly 
ranked attributes of quality special education programs. 

In this survey, the DOSE and SOS were told the ten goals or attributes of the high school 
special education program for students with mild to moderate handicaps. They were then 
asked to judge the extent to which a variety of educational activities included in their programs 
contributed to realizing those goals or enhancing those attributes. Remarkable congruence 
was evidenced across the ratings of the DOSE and SOS. The groups had comparable 
perceptions on the contributions that the different activities made to the set of desired attributes. 
This congruence waa reflected in that only four of the twenty-eight activities had statistically 
significant different mean utility values, and in the high correlation between the groups' rank 
ordering of the activities' utilities' values, r = .896. These findings suggest that the two groups 
share a very similar perspective about the value of particular high school special education 
programs' activities. This shared perspective should provide an important basis on which 
reforms in special education can be discussed as well as for defining the relationship between 
special and regular education. 

An important implication of these data is that from the perspective of a school's district 
level administration an integrated model of regular and special education services might be 
better understood. This integrated model provides the valued attributes of special education 
which in turn can be compared to the attributes of regular education and the programmatic 
activities of each curriculum. The results from Survey 3, the Weighting Survey, which 
indicated a shared perspective on the important attributes of high school special education 
programs, when integrated with the results of this survey provide another level on which high 
school special education programs can be planned, directed, and evaluated. The previous 
surveys (1 through 3) established the conceptual framework of desired attributes and program 
activities. With Survey 4 those attributes and activities were identified and linked in a 
quantitative relationship through the utility measurements. The activities have been rank 
ordered for their utility to foster the achievement of the identified program attributes. This 
data set provides that perspective at a national level across multiple states. However, also for 
local educational agencies and even state agencies a paradigm exists for directing special 
education reforms which could better integrate the programatic directions of regular and 
special education. The uniqueness of special education programs could be better defined in 
terms of both goals and instructional and curricular activities. This uniqueness of the 
respective programs would be evidenced through a comparison of goals and instructional and 
curricular activities provided in each. While this distinction between program goals and 
instructional activities might help explain or justify the differential in resource allocations, 
on the very practical level of developing students' Individual Educational Plans, this survey 
provides additional valuable information. Those individuals responsible for such decisions 
now have a frame of reference for judging the differences between alternative curricular 
offerings in regular and special education and the relationship of specific program activities 
to achieving those curricular goals. 
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At least one other value of these data which was alluded to previously is that of using the 
data as a baseline for the current relationship between desired goals of high school special 
education programs for students with mild to moderate handicaps and the program's 
activities. These data might be interpreted from the perspective of a needs assessment in 
which this current baseline is used to direct changes in the relative emphasis attached to 
particular goals or to the activities for realizing those goals. For example, the DOSE cited 
"Inclusion in regular school activities" as the activity which had tjhe greatest utility for the 
identified attributes. A possible follow-up question which might be examined is *What are 
those regular school activities which are valued and in what other ways might the students 
participate and also benefit?" An additional question might be to ask "What characterizes 
those regular school activities which foster participation of students with mild to moderate 
handicaps?" The depth and methods of addressing such questions could also be quite variable 
and accommodate the diversity of schools' and districts' characteristics. The outcome of such 
an inqtiiry is that a broader and more comprehensive perspective might be obtained on the 
value and limitations of various aspects of the student's educational experience. More 
directly, such information would add to vmderstanding our schools' influence on such 
functions as students* participation in the larger society as knowledgeable citizens, wage 
earners, and members and transmitters of the American culture. 

An interesting contrast between the DOSE and SOS responses is the difference between 
the two program activities which the respective groups rated as having the greatest utility. As 
mentioned above, the DOSE gave their highest ratings to "Inclusion in regular school 
activities." The SOS rated this activity as seventh. The activity having the greatest utility for 
the SOS was "Instruction in basic skills," which in turn was rated fourth by the DOSE. While 
overall the correlation between the two group's ratings was high, such differences also point out 
a difference of fundamental perspectives about these students with mild to moderate 
handicaps. This difference of perspectives deserves further exploration. 

Limitations 

Although the Implementation Survey for DOSE and SOS involved 400 DOSE and 450 SOS 
randomly chosen from an original database of 800 DOSE and 900 SOS from 12 states, the usual 
constraints apply regarding inferring conclusions with knowledge of the population, the 
sample, the return rate, and the survey instrument itself. The survey participants were 
randomly chosen without replacement from the states of Delaware, Iowa, Indiana, Kansas, 
Kentucky, Missouri, Nevada, New Hampshire, North Carolina, Oregon, Pennsylvania, and 
South Dakota to represent school administrators in the nation. The return rate was 44% for the 
DOSE and 34% for the SOS; of 400 surveys sent to DOSE, 176 were returned, and of 450 surveys 
sent to SOS, 151 were returned. The return rate was less than desirable and suggests that a 
different methodology for data collection may be warranted in follow-up studies, e.g., phone 
interviews and focus groups. 

Implications for Future Research 

As a consequence of this survey's data, two questions appear particularly relevant: (1) 
What is the relationship of the program activities to individual program attributes? and (2) On 
what parameters such as content, instructional grouping, pace, instructional objectives, and 
instructional delivery should the varied program activities be meaningfully and usefully 
defined? The former question focuses on choosing one of the ten program attributes of interest 
and determining which of the activities have the greatest utility for realizing that attribute. 
Such a question is not inconsistent with the information in the data set and has a ready utility 
by increasing specificity. One might then know which of the many activities are judged as 
most relevant for achieving a particular goal. For example, in planning reforms, this 
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approach may have greater value because one can individually examine the program 
attributes and which of the activities were judged as particularly important to that attribute. 

The second question concerning parameters of the program activities has direct 
implications for implementation. While the program activities were considered as mutually 
exclusive for the purposes of this project, similarities remain. Thus, an important issue is 
determining the parameters or dimensions on which the particular activities iright be 
considered as distinctive. Examples of such parameters include content emphasis grouping 
patterns, instructional objectives, criteria for judging performance, instructional setting, and 
integration across domains. Methods for developing such relationships are included in 
concept mapping. We believe that for the program activities to be meaningfully considered in 
light of defined goals, the activities must have shared meaning and uniqueness. As a first 
step this shared meaning is accomplished through clear conceptual and, ultimately, 
operational definitions. With that foiindation, a district, state, or other group could proceed 
with more substantive discussions of planning and implementation of appropriate transition 
curricula across grade levels and settings. 

Recommendations 

We recognize the potential for a variety of recommendations given the richness of this 
survey s data. However, we have adopted a strategy of emphasizing a relatively few, narrowly 
defined recommendations. These recommendations have been organized to direct activities 
at both the local education agency level and at the state education agency. Again, we do not 
pretend that these recommendations are sufficient to adequately represent the findings. 

Local education agency reco mmend a ti on r . The similarity between DOSE's and SOS's 
utility measurements was a (pleasant) surprise. As a consequence, we concluded that this 
shared similarity implies shared responsibilities and perceptions. With that foundation we 
recommend: 

1) That disTx ict level administration initiate a review or evaluation of the linkages and 
barriers between special education's service delivery and the regular higli school 
program. This evaluation must include two critical attributes: (a) that the emphasis be 
given to the secondary level of education rather than the primaiy and intermediate 
levels; and (b) that the reference of the evaluation should be in terms of the desired 
student outcomes. With these two criteria as foundation stones, other aspects of the 
review, such as inclusion of parents, students, graduates, business and community 
leaders, high school faculty, and administration and the methods of data gathering and 
analyses can be addressed. 

2) That programmatic goals be hierarchically arranged and compared to curricular 
content and activities. Our perception of the responses suggests that a shared 
relationship of the course content and the program's goals is implicit. However, we 
believe that the quality of students* programs could be improved if these relationships of 
goals and content were made explicit. Such descriptions would aid in planning a 
student's program, as well as from the larger perspective, point out gaps in the program 
curriculum and goals. A third dimension of this relationship should also be explored, 
namely, the application range 

State educational aeencv recommendations. State education agencies (SEAs) play the 
pivotal role mth legislative and interagency issues. No other group within the state has that 
capacity. From that perspective, we envision that SEAs can build a shared vision of how high 
school students, who are so soon to become adults, can successfully make the transition from 
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high school settings to their future participation in a larger society. As such, this role leads us 
to offer the following recommendations: 

1) That SEAs actively construct a sense of partnership among relevant agencies to 
ensure students' successful transition. Individual districts can and should continue to 
direct their efforts at working with local community resources for providing avenues to 
independence for their students. However, such efforts do not need to be in isolation of 
activities developed by other districts or agencies. In this area the SEA can serve as a 
clearing louse for collecting and disseminating districts' current practices. In 
addition, the SEA can help intervene for local districts with interagency administrative 
structures and barriers, such as those experienced with vocational rehabilitation, 
vocational and technical education agencies, and other post-secondary educational 
programs. The SEA activities could provide an umbrella or, to use an opposite analogy, a 
foundation framework in which local efforts could be planned and implemented. State 
agencies have different missions for which structures are developed and resources 
allocated. The SEA could work to highlight how those structures and resources, which 
might be used in the local district, might ensure students' successful transition. 

We believe that such a recommendation requires minimal new resources, but 
rather emphasizes a redirection of current resources. We advocate such a reallocation 
with an assumption that if students do not make successful transitions, the risks are 
significantly increased that they will be making greater demands for a longer period of 
time on other agencies' resources as clients. With a restructuring of complementary 
agencies and greater partnership among LEAs and agencies, we believe that students' 
transitions could be more successful. 

2) Hiat SEAs recognize a stronger role for accountability measui^ in their provision of 
resources to local districts. We believe that an important function of SEAs concerns 
setting and monitoring standards of quality. On the other hand, local districts 
frequently feel controlled by their state departments of education and perceive SEAs as 
lacking sensiti\nty to the local situations. To the extent that such feelings are accurate, 
calls for increased accountability are not deemed useful. However, we believe that such 
accountability measures need not be punishing and tliat increased accountability need 
not impose other, external standards of quality. The local standards might be accepted 
as appropriate. However, the initial first step is to ensure that the local standards of 
quality are identified and that local outcomes are examined in light of those standards 
as an index of performance. Quite simply, our recommendation is that local districts 
ensure that standards of quality have been identified and that they are held accountable 
to those standards. The SEA can assist with both factors. 

Our rationale for this recommendation is a belief that most local education 
agencies (LEAs) are unlikely to establish clear operational statements of expectations 
for their programs, and even less likely to evaluate their programs. We believe that such 
an evaluation component provides feedback which in turn results in a sharper focus and 
improved services, i.e., an improved match between the goals and the activities within 
special education programs. Resources are linked to this evaluation component in a 
nominal manner so that those LEAs which have the procedures for such an evaluation 
are rewarded with discretionary funds from the SEA. The greater burden for this 
recommendation is with SEAs, which must shift its balance from monitoring and 
compliance with state and federal directed standards to recognizing the value of local 
standards as well. 
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and Conclusions 

A matrix was created in which the mean weights of the program attributes, obtained from 
the Weighting Survey, made up the columns. The program activities represented the matrix's 
rows. Individual cells held the product of the program attribute's weight by the location 
measure ((viz., the ranking given by the DOSE or SOS, ranging from 1 (low) to 6 (high)) 
assigned by the respondent. The products were summed across the columns to determine the 
utility measurement of a given activity. The results were summed across all the respondents 
within the group, DOSE and SOS, to generate the utilities for each of the program acti\ities. 

The Implementation Survey for DOSE and SOS generated a numerical value for the 
degree to which a special education program activity influenced an attribute of successful 
special education programs. Previous surveys, specifically, the Elicitation Survey, the 
Ranking Survey, and the Weighting Survey, were essential to this Implementation Survey. 

The ten program activities with the highest utility measurements, as rated by the DOSE 
(see Table 32) were: "Inclusion in regular school activities," "Individualized instruction," 
"Regular and adapted vocational education," "Basic skills instruction," "Functional 
academics instruction," "Inclusion in mainstream classes," "Guidance and counseling 
services," "Academic assistance for mainstream classes," "Social skills instruction," and 
"Work study program." 

The SOS agreed with the DOSE in nine of the ten highest-ranked activities (see Table 32). 
Nine of the ten activities ranked highly by the DOSE were also in the top-ten ranking of the 
SOS: "Basic skills instruction," "Inclusion in mainstream classes," "Academic assistance 
for mainstream classes," "Individualized instruction," "Functional academics instruction," 
"Guidance and counseling services," "Inclusion in regular school activities," "Social skills 
instruction," and "Regular and adapted vocational education." 'Work studv program," 
ranked 10th by the DOSE, was ranked 15th by the SOS, while "Pre-vocational rmd career' 
education", ranked 9th by the SOS, was ranked 11th by the DOSE. 

The five program activities with the lowest utility measurements, as ranked by the 
DOSE, v%'ere: "Fine arts instruction," "Computer assisted instruction and training," 
^'Community-based instruction," "Speech and communications instruction," and 
"Assessment plan." 

Similarly the SOS agreed with the DOSE on three of the five lowest-ranked activities: 
"Community-based instruction," "Fine arts instruction," and "Computer-assisted 
instruction and training." "Assessment plan" and "Speech and communications 
instruction," ranked 24th and 25th by the DOSE, were ranked 21st and 18th, respectively, by the 
SOS. On the other hand, "Peer tutoring and peer couJiseling," and "Job placement program," 
ranked 24th and 27th by the SOS, were ranked 20th and 21st, respectively, by the DOSE. 

This Implementation Sun'ey to directors of special education and superintendents of 
schools was used to establish the relationship between the influence of current special 
education program activities on attributes considered important to special education programs 
for students with mild to moderate handicaps. A surprisingly high agreement was noted 
between the groups' responses. The directors and superintendents perceived that secondary 
level special education program activities in general have similar value for the set of 
attributes. From our perspective, we want to emphasize the important relationships between a 
program's attributes and the activities which might foster the development of those attributes. 
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High School Special Education Program Attributes 



Liirec ri o n s 



_ Complete the fallowing questions by referencing vour h^-Qh 
scnool s special education programs for students with~STld to 
moderate handicaps. 



Circle the number which best represents your judgment. If a 
program activity minimally applies to the attribute, circle "1 " 
If the activity highly applies to the attribute, circle "e'" 
Values between 1 and 6 allow you to specify the degree t • whic'h 
the activity applies. If the activity is not available in you^ 
program, circle "NA." meaning "not available." ^ 

Example 

Suppose one of the important attributes of a traditional 

a^%'uiVe° ■•slilir'''°" ^° which stid n 

acquire skills in accepting criticism." A variety of training 
activities are included in many vocational programs, eg (a) 
fore:;:r\e\\T'''' '-'^ ^^^^^-^ exercisers, fnd (c) I'.l'^i:! 

Question: To what extent does each of the following 
activities develop a student's skills in acce^tin^ crii^ 

High Training Activity 

© 5 6 (a) classroom lectures 

2 3 ^ (5) 6 (b) role playing exercises 

^ ^ ^ 5 6 (c) on-the-job experience 

"classroom lectures" provide some information on skills 
"Rol. n? ' ---ticism but not much, thus the rating of "2 " 

.lllldlVrd r^a\Yn\^r- Ht^re^^-r-^Vh^e o"^^^"^^ — ' 
"on-the-iob trp-i n-i no t. • Program does not offer 

available." '""^"^"S' ^ence it was rated "NA." meaning "not 
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National High School Project ^^251 
Evaluation of High School Level Special Education 
for Students with Mild to Moderate Handicaps 



1, To what extent does each of the foiiou-.n- program activities develop 

successful independent living skills ? " ^ ^ 7 ^ 



jrrograni ACuivities 
(a) Career education 




NA 


Low 
1 2 


3 


4 


High 
5 6 


(6) 


w 


(b) Fine arts instruction 




NA 


1 


2 


3 


4 


5 


6 


(23) 




(c) Peer tutoring and peer counseling 




NA 


1 


2 


3 


4 


5 


6 


(15) 


• 


(d) Transition planning 




NA 


1 


2 


3 


4 


5 


6 


(19) 


(e) Computer-assisted instruction and training 


NA 


1 


2 


3 


4 


5 


6 


(21) 




(f) Behavior modification plans 




NA 


1 


2 


3 


4 


5 


6 


(26) 


# 


C^j Driver^ s educAtion ^nc^vnr»^-;/^T-» 




NA 


1 


2 


3 


4 


5 


6 


(A) 




To what extent does each of the following 
a vocational and career orientation? 


program 


activities 


incorporate 




(12) 




Program Activities 
(a) Physical education instruction 




NA 


Low 
1 2 


3 


4 


High 
5 6 


(2) 


w 


(b) Transition planning 




NA 


1 


2 


3 


4 


5 


6 


(19) 




(c) Social skills instruction 




NA 


1 


2 


3 


4 


5 


6 


(8) 


W 


(d) Assessment plan 




NA 


1 


2 


3 


4 


5 


6 


(28) 




(e) Guidance and counseling services 




NA 


1 


2 


3 


4 


5 


6 


(9) 




(f) Inclusion in mainstreaming classes 




NA 


1 


2 


3 


4 


5 


6 


(13) 




(g) Learning strategies instruction 




NA 


1 


2 


3 


4 


5 


6 


(10) 




To what extent does each of the following program activities 
leadership and support from jrour hi^ school administration'^ 


develop 


successful 
(36) 




Program Activities 
(a) Inclusion in mainstreaming classes 




NA 


Low 
1 2 


3 


4 


High 
5 6 


(13) 




(b) Work-study program 




NA 


1 


2 


3 


4 


5 


6 


(7) 




(c) Social skills instruction 




NA 


1 


2 


3 


4 


5 


6 


(8) 


• 


(d) Transition planning 




NA 


1 


2 


3 


4 


5 


6 


(19) 




(e) Independent living skills instruction 




NA 


1 


2 


3 


4 


5 


6 


(3) 




(f) Career education 




NA 


1 


2 


3 


4 


5 


6 


(6) 


• 


(g) Inclusion in regular education school 


activities NA 


1 


2 


3 


4 


5 


6 


(12) 
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4. To what extent does each of tne following program activities influence 

C16) 



^ , - 

successtui personal and social adjustment ? 





(a) 


Program Activities 
Behavior modification plans 


NA 


L 


ov 


3 


■4 


High 
5 6 


(26) 


• 


(b) 


Guidance and counseling services 


NA 


1 


2 


3 


4 






(9) 




(c) 


Academic assistance for mainstreamed classes 


NA 


1 


2 


3 


4 


R 


D 


(11) 




(d) 


Speech and communications instruction 


NA 


1 


2 


3 


4 


5 


6 


(20) 


• 


(e) 


Driver's education instruction 


NA 


1 


2 


3 


4 


5 


6 


(A) 




(f) 


Peer tutoring and peer counseling 


NA 


1 


2 


3 


4 


5 


6 


(15) 




(g) 


Individualized instruction 


NA 


1 


2 


3 


4 


5 


6 


(14) 



5. To what extent does each of the following program activities elicit 

^^PP"'^^ iiiif . parents , business and the community ? (27) 

Program Activities . „. , 

(a) Social skills instruction ^ ^ |lS| 

(b) Transition planning NA 1 2 3 4 5 6 (19) 

(c) Speech and communications instruction NA 1 2 3 4 5 6 (20) 

(d) Inclusion in regular education school activities NA 1 2 3 4 5 6 (12) 

(e) Behavior modification plans NA 1 2 3 4 5 6 (26) 

(f) Physical education instruction NA 1 2 3 4 5 6 (2) 

(g) Work adjustment and work activities NA 1 2 3 4 5 6 (24) 



(24) 



^' ''lot'liTTcL^r following program activities contribute to 

Zour hi^ school special educat ion teachers ' success with students ? 

Program Activities -^^^ 

(a) Academic assistance for mainstreamed classes NA 1^2 3 4 (n) 

(b) Work adjustment and work activities NA 1 2 3 4 5 6 (24) 

(c) Assessment plan it. ■, ^ 

^ NA 1 2 3 4 5 6 (28) 

(d) Regular and adapted vocational education NA 1 2 3 4 5 6 (5) 

(e) Independent living skills instruction NA 1 2 3 4 5 6 (3) 

(f) Inclusion in regular education school activities NA 1 2 3 4 5 6 (12) 

(g) Behavior modification plans NA 1 2 3 4 5 6 (26) 
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To what extent does each of the following program activities contribute to 
a post - secondary transi tion curriculum ? fq^ 



Program ActivitK^s 
(a) Driver's education instruction 




NA 


Low 
1 1 




- 


Hi 
5 


6 


(4) 




(b) Vocational .assessment 




NA 


1 


2 


3 


4 


5 


6 


(17) 




tcj Inclusion in regular education school 


activities 


NA 


1 


2 


3 


4 


5 


6 


(12) 




(d) Parent or employer involvement 




NA 


1 


2 


3 


4 


5 


6 


(27) 




(e) Guidance and counseling services 




NA 


1 


2 


3 


4 


5 


6 


(9) 


# 


(f) Hands-on materials and activities 




NA 


1 


2 


3 


4 


5 


6 


(22) 




(g) Individualized instruction 




NA 


1 


2 


3 


4 


5 


6 


(14) 




To what extent does each of the following 
employment success? 


program activities 


influence 




(15; 




Program Activities 
(a) Social skills instruction 




NA 


Low 
1 2 


3 


4 


High 
5 6 


(8) 




(b) Career education 




NA 


1 


2 


3 


4 


5 


6 


(6) 


• 


(c) Computer-assisted instruction and training 


NA 


1 


2 


3 


4 


5 


6 


(21? 




(d) Job placement program 




NA 


1 


2 


3 


4 


5 


6 


(25) 




(e) Behavior modification plans 




NA 


1 


2 


3 


4 


5 


6 


(26) 


• 


(f) Inclusion in regular education school 


activities 


NA 


1 


2 


3 


4 


5 


6 


(12) 




(g) Basic skills instruction 




NA 


1 


2 


3 


4 


5 


6 


(1) 





9. To what extent does each of the following program activities successfully 

involve regular education support and integration ? (3) 

Jl21£ifn Activities Low Hi^ 

Uj hands-on materials and activities NA 1 2 3 4 5 6 (22) 

Co) Regular and adapted vocational education NA 1 2 3 4 5 6 (5) 

(c) Community-based instruction NA 1 2 3 4 5 6 (18) 

(d) Individualized instruction NA 1 2 3 4 5 6 (14) 

(e) Behavior modification plans NA 1 2 3 4 5 6 (26) 

(f) Speech and communications instruction NA 1 2 3 4 5 6 (20) 

(g) Physical education instruction NA 1 2 3 4 5 6 (2) 
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(1) 



10. To what extent does each of the following program activities contribute to 
mdiviQualized . approDriate instruction ? 

Progra m Activities 

..a, bpeech and communications instruction ma > - • /^^n 

A - w D o {.ZOj 

(b) Learning strategies instruction NA 1 2 3 4 5 6 (10) 

(c) Regular and adapted vocational education NA 1 2 3 4 5 6 (5) 

(d) Inclusion in regular education school activities NA 1 2 3 4 5 6 (12) 

(e) Work adjustment and work activities NA 1 2 3 4 5 6 (24) 

(f) Hands-on materials and activities NA 1 2 3 4 5 6 (22) 

(g) Peer tutoring and peer counseling NA 1 2 3 4 5 6 (15) 
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School Superintendents and Directors of Special Education 

Information 

Please c h e c i< one : 

I am a school superintendent. 

director of special education. 

other. (Tell us,) 



2. The region in which I work might be best characterized as: 

ruralj isolated geographically and sparsely populated 

rural, small town 

suburban 

urban 

3. Please complete one of the following statements (a or b): 
a. What is the total enrollment in your school district? 



b. If your service area includes a number of school districts, such 
as in a special education cooperative or interlocal, what is the 
total enrollment of those school districts? 



4. What was the last degree you earned? (Please check.) 

B.A./B.S. M.A./M.S. Ed. Spec. Ph.D./Ed.D. 

5. How many years have you been at the current district? 



6. Please correct any incorrect information on the attached mailing 
label : 



Please use the enclosed envelope and oiail this survey to us by 
May 15, 1987 (Friday). Thank you. 

If you would like a summary of our results, please write your name 
and address on the back of the return envelope, 

i 
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Survey 5: Implementation Survey of Pkie-servioe 
Special Education Teacher Training Activities 



Overview 

The high school's instructional experiences provide the last formal educational 
opportunities for most students with mild to moderate disabilities. Numerous reports on the 
efficacy of these experiences have been equivocal or at best very troubling. Many revi-.wers 
have called into question the value of special education services as they currently are provided 
and speculated on alternative organizational changes to better accommodate students 
identified as having special needs. 

From the National High School Project staffs perspective, very important aspects of these 
high school experiences can be understood by examining both the relative emphasis given to 
different curricular content and activities and the characteristics of those instructors 
providing the learning experiences. The curricular aspects of the high school special 
education experiences were reviewed in the results reported in the section entitled "Survey 4: 
Implementation Survey of High School Special Education Program Activities." This section 
details the methodology and findings of the Implementation Survey mailed to pre-service 
teacher trainers (PTT) at institutions of higher education. This survey is a parallel of the 
format from Survey 4 used with the directors of special education (DOSE) and superintendents 
of schools (SOS), but differs to reflect the emphasis and perspective provided by pre-service 
teacher trainers. The previous surveys provided a framework for understanding desired 
attributes and activities in a high school special education program and the desired qualities of 
instructional staff in that setting. Indeed, in Survey 4 the numerical relationship between 
program attributes and activities was identified. This relationship provided a quantitative 
dimension to understanding how different curricular activities and content v/ere perceived as 
facilitating particular program goals. On the basis of such information state and local 
education agencies could examine their own special education programs for a variety of 
purposes, such as a needs assessment or to establish a baseline against which changes could be 
monitored. 

As indicated above, in addition to a program's curricular content and activities, another 
major facet is the quality of the instructional staff. More than any other single factor the 
instructional staff is responsible for a program's quality. This finding was confirmed in both 
Survey 3, the Weighting Survey, and the qualitative component of the National High School 
Project (Knowlton & Clark, 1989). Given this, the pre-service program is believed to have the 
major influence on the entiy level skills of the instructional staff. Thus, on the basis of these 
perspectives, an important inquiry is the relationship between the desired qualities of high 
schools' teaching staffs and pre-service training activities. This relationship was assessed in 
Survey 5, the implementation survey to pre-service teacher trainers. The question could be 
stated as: Given a defined set of ten desired teacher attributes, which pre-service training 
activity has the greatest utility for developing that defined set of desired teacher attributes? 
Recall that the ten desired teacher attributes identified in Survey 2, the Ranking Survey, 
included: (1) Instructional skills, (2) Assessment skills for planning and instruction,' 
(3) Curriculum and instructional planning skills, (4) Knowledge of transition, (5) Behavior 
management skills, (6) Works well with people, (7) Classroom organization skills, 
(8) Works cooperatively with staff and administration, (9) Skill in assessing outcomes, and 
(10) Incorporates vocational/career education. 
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Methodological Considerations 

The survey methodology used in the National High School Project was designed to 
establish a database of the perspectives held by directors of special education, superintendents 
of schools, and pre-service teacher trainers on the desired qualities of high school special 
education programs and staff. In this particular survey, the efforts were directed at 
establishing the relationship of teacher training programs' activities with the desired 
qualities of high school instructional staff for students with mild to moderate handicaps. That 
is, in the judgment of the special education teacher trainers themselves, how well do the 
activities in their programs develop identified, desired skills in teachers? 

The methodological issues in this fifth survey were the same ones as described for 
Survey 4. That is, two major concerns were identified. The first concern was to minimize the 
effort required of the respondents both to ensure a high participation rate and the accuracy of the 
data provided. A matrix sampling plan was followed again to reduce the number of responses 
required by any one respondent. Further elaboration of the matrix sampling procedures are 
provided in the procedures section of this report. 

The second methodological issue was the concern regarding possible order eff'>cts if all 
the respondents received uniform survey items all in the same order. As in Survey 4, a 
randomization procedure was followed in which the computer generated unique versions of the 
survey. 



Method 



Subjects 

Part of the first mailing for Survey 1, the Elicitation Survey, was a letter to 716 special 
education department chairpersons at institutions of higher education. The chairpersons were 
asked to complete and return a stamped postcard. On the postcard, the respondents were to 
write the names and addresses of colleagues who were teacher trainers for secondary settings 
and would be interested in participating in the study. This process generated 640 names from 
fifly states which were entered into a database for the mailing list. From this list, 550 names 
were randomly selected without replacement. The minimum criterion employed was that at 
least one individual from each state must be included in the sample. Among the 550 names, 
225 Pre-service Teacher Trainers (PTT) were sent the Weighting Survey (Survey 3), while 325 
were targeted for Survey 5, the PTT Implementation Survey. 

Materials 

Two versions of the Implementation Survey were developed: one for the DOSE and SOS 
and another for the PTT. The DOSE and SOS version, generating multi-attribute utility 
measurements of special education program activities, was discussed under Survey 4. 

This section details the Implementation Survey for the PTT, which employed a multi- 
attribute utility measurement procedure and generated a numerical value for the degree to 
which pre-service training activities foster the attributes of special education teachers. 

Construction of survey « The main body of the survey (see Appendix L for a sample form) 
was comprised often items. Each item corresponded to a separate special education teacher 
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attribute, identified as among the top ten by professionals who participated in the Ranking 
Survey (Survey 2). These top ten attributes were previously identified fi^om a list of 23 
categorized in the Elicitation Survey (Survey 1). 

A sample item is presented in Figure 3. In this example, two teacher attributes are 
presented with six accompanying training activities. Respondents assigned a value ranging 
from "1" (low) through "6" (high) to six pre-service teacher training activities listed with each 
teacher attribute. The respondents were asked to choose a value based on the degree to which the 
training activity contributed, developed, or otherwise influenced the particular teacher 
attribute. If the training activity was not part of the respondent's particular special education 
teacher training program, then s/he assigned a value of "NA (not applicable), to the training 
activity. 

The top ten attributes of quality special education teachers, identified in the Ranking 
Survey (Survey 2) were randomly ordered for each survey form using a Pascal computer 
program. The Pascal computer program (see Appendix M) was used for generating the 
surveys to achieve uniqueness for each of the survey forms. Six training activities were 
randomly selected without replacement and randomly ordered for each of the ten teacher- 
attribute items. The six training activities were randomly selected from the set of 18 
categorized in the Elicitation Survey (Survey 1). 

Consideration was given to how many of the 18 activities should be presented with each of 
the ten attributes. Six was chosen as a number which seemed reasonable for the type of decision 
required, the speed at which each item could be completed, and the total time involved. A 
minimum of 30 responses for each activity was considered necessary to jdeld a stable 
measurement of each training activity. By using six activities for each of the ten attributes, the 
respondents were asked to make 60 judgments (6X10 = 60) in the survey. Each survey was a 
unique form due to these random selection of the six training activities from the set of 18 and 
random ordering (of the ten teacher attributes as well as the six randomly selected training 
activities) procedures for generating the survey items. 

Construction of background information fifictifln. The first two pages of the PTT 
Implementation Survey was designed to elicit background information regarding each 
survey participant. Respondents were asked to signify their last degree earned, area of 
specialization, age level of specialization emphasis, number of years in current institution, 
percent of time spent in work-category area, number of students enrolled at the institution, 
special education teacher-certification requirements, and number of faculty members in the 
department. 

Survey Procedure 

This section describes the survey procedure followed, starting with the pilot test, then the 
survey dissemination and returns, the data coding for the survey forms returned, and the data 
analyses on the resulting database. 

Eikt tfist. Prior to the Weighting and Implementation Surveys, two pilot studies were 
conducted. The first one involved staff members of the Institute for Research in Learning 
Disabilities at the University of Kansas and was a precursor to the Weighting Survey, which is 
discussed in the report on Survey 3, the Weighting Survey. 
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The second pilot study was conducted in a graduate level research design class at the 
University of Kansas. In February, 1987, class members were asked to complete the pilot 
version of the survey which used the multi-attribute utility measurement procedure. Helpful 
recommendations and clarifications resulted from both pilot studies. 

Survey mailing. The Implementation Survey was mailed in the week of April 17, 1987. 
The mailing included a letter of explanation, the survey itself, a postage-paid return envelope, 
and a pencil to facilitate the respondent's reply. 

Survev returns. Table 36 shows the number of PTT Implementation Surveys mailed out 
to institutions of higher education as well as the number and percentage of respondents. 



Table 36 

Mailing Targets and Respondents for the PTT Implementation Survpy 



Number of survey forms 


Mailed 


325 


Returned usable 


104 


Returned unusable 


17 


Total returned 


121 




(37.23%) 



IMa. PTT = Pre-service Teacher Trainers. 



Eata coding - As the survey forms were returned by mail, each set was assigned an 
identification number for tracking purposes. Seventeen returned surveys were found 
unusable, most of them for the reason that the items were not completed, i.e., the respondent 
could not or chose not to respond to the ten items. Those returned surveys that were found 
usable were coded for data entry and entered into a database for statistical analyses. 

On the surveys the background information and survey responses were coded. The 
survey responses are technically referred to as a location measu/e. which in this survey was 
the number (ranging from one through six) assigned by the PTT for a particular training 
activity's impact on a teacher attribute. 

The location measure represented each respondent s view of the extent to which a 
particular training activity contributed, developed, or influenced a teacher attribute. A low 
value (1 or 2) indicated that the activity made little contribution, while a high value (5 or 6) 
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indicated that the activity made a major contribution to the particular teacher attribute. Thus, 
the utility measurement reflected the importance that the respondents attached to particular 
training activities as a means of realizing teacher attributes. The training activity with the 
highest numerical value can be regarded as the activity which has the greatest utility or value 
in attaining the desired teacher attributes. 

In computing the utility measurements for the teacher attributes, a database was created 
which might be conceptualized as a matrix of rows and columns. A matrix was developed for 
each respondent The matrix's columns represented each of the teacher attributes with its 
calculated mean weight (obtained from the Weighting Survey). Each of the top ten teacher 
attributes identified in the Ranking Survey was weighted by the PTT, These weights were the 
results reported in the Weighting Survey. The matrix's rows represented the training 
activities. The individual cells included the product of multiplying a teacher attribute's 
weight by the location measure assigned by the respondent The utilities were summed across 
all of the attributes (columns) to determine the overall utility of a given activity. In the 
analyses, the focus was on the utility measurements assigned to the training activities. 

Once these computations were completed for each respondent, the results were summed 
across all survey respondents. These sums were the utilities for each of the training activities. 
However, since the magnitude of the sum depended in part on the number of respondents, 
statistical analyses were required before further interpretations could be completed. 

Data analyses. Statistical indices were calculated on the utility measurements of the 
pre- service training activities. The analysis was directed at determining the overall 
training activities judged as having the greatest utility, and then secondly, whether or not 
particular characteristics of the respondents influenced their judgments. In that regard the 
PTT respondents were subdivided on three variables: number of years in current institution, 
percent of time spent on teaching, and enrollment size at institution. For number of years in ' 
current institution, the PTT were subgrouped into the following categories: 1 (1 through 5 
years), 2 (6 through 11 years) and 3 (12 through 29 years). The percent of time spent on teaching 
categories were: 1 (5% through 43%), 2 (45% through 65%), and 3 (70% through 97%), The 
enrollment size subdivisions were: 1 (2,500 students or less), 2 (2,501 to 10,000 students) and 3 
(10,001 students or more). 

In the analyses, the dependent variables were the 18 training activities and the 
independent variables were the subgroupings of the PTT on the three aforementioned 
variables. These statistics included descriptive statistics - means, standard deviations, and 
confidence intervals. In addition, inferential statistics were generated for comparing the 
PTT subgroups' rankings of the pre-service training activities. 



KHS Implementation Survey for PTT 8/13/92 IQQ 



o 2 .J 



ERIC 



Results 



Descriptive Statistics 

Table 37 shows the mean weight, standard deviation, and 95% confidence interval for 
each pre-service training activity. These values are based on the assigned ranks by the 103 
responding pre-service teacher trainers. The training activities are listed in rank order on 
the basis of the utility measures (derived from the matrix of teacher attribute mean weights and 
location measures) assigned by the PTT for each training activity. The activity having the 
highest utility from their perspective has the rank of 1. 

This listing provides important insight into the value that teacher trainers place on the 
diverse training activities which were identified in the first survey of the project, the 
Elicitation Survey. The first part of the listing, which contains those activities having the 
greatest value, differ from those activities appearing later in the list. The first six of these 
activities emphasize student activity. The student is engaged in an experience (e.g., "Student 
teaching," "Modeling and demonstrations," "Clinical teaching," "Observational activities," 
"Simulations," and "Curriculum development activities") that on first blush reqmres a 
higher level of direct involvement than those activities appearing later in the list. These 
experiences also have an emphasis on approximating the teacher role. The next six activities 
have a lower level of direct involvement and, as such, are more passive, e.g., seminars, 
lecture coursework, videotape and media usage, discussion groups, on-going assessments, 
and oral presentations. 

Interestingly, "In-service activities" ranked 16^^ on the list. Recall that in the initial 
survey. Survey 1, titled the Elicitation Survey, the three responding groups, DOSE,. SOS, and 
PTT, were asked to identify any important training activities important to developing and 
improving teachers' skills. "In-service iv: tivities" was nominated among other activities, 
and was thus included based on those responses. Only in Survey 5 did the focus shifl to 
emphasizing activities from the perspective of "pre-service" training rather than training in 
general. 

While in-service activities are frequently required by state departments of education, 
one might question the value of such a training procedure in light of its rank among these 
activities. Perhaps some of the activities having a higher rank would be more suitable for 
continuing professional development among instructional staff. For example, could a 
mentoring program, comparable to student teaching procedures, be suitable? No doubt one of 
the difficulties with in-service activities is maintaining continuity across a series of sessions 
which are frequently separated by significant time gaps. 

That "Computer -assisted instruction" ranked last among the 18 activities may be 
surprising. While computers have demonstrated utility for a variety of instructional 
activities in the K-12 system, that value apparently is not recognized among pre-ser\nce 
teacher trainers. Teachers' skills and knowledge of computers are developed as a splinter of 
their training experiences rather than being integrated within the training. 
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Table 37 

PTT Rank-ordered Cell Means and Standard Deviations of Pre-sftrvicfi Training Activities 
(11=103) 



Pre-service training activity 


Rank 


Mean 


Std. dev. 


95% conf. int. 


Student teaching activities 


1 


177.52 


92.94 


159.35 to 195.68 


Modeling & demonstrations 


2 


169.52 


91.22 


151.69 to 187.34 


Clinical teaching 


3 


163.29 


93.93 


144.94 to 181.65 


Observational activities 


4 


151.76 


77.47 


136.62 to 166.90 


Simulations 


5 


149.71 


80.82 


133.91 to 165.51 


Curriculum development experiences 


6 


136.81 


74.28 


122.29 to 151.32 


Formal & informal seminars 


7 


128.31 


77.45 


113.17 to 143.45 


Lecture coursowork 


8 


125.62 


67.12 


112.50 to 138.74 


Videotape & media usage 


9 


124.83 


62.98 


112.52 to 137.13 


Large & small group discussions 


10 


123.77 


65.56 


110.95 to 136.58 


On-going assessments 


11 


119.26 


67.43 


106.08 to 132.44 


Students' oral presentations 


12 


117.77 


62.48 


105.56 to 129.98 


Case study presentations 


13 


111.11 


64.16 


98.57 to 123.65 


Individual advisement & conferences 


14 


110.26 


69.47 


96.69 to 123.84 


Group experiences 


15 


109.93 


59.92 


98.22 to 121.64 


In-service activities 


16 


106.46 


83.70 


90.10 to 122.81 


Research experiences 


17 


92.33 


59.66 


80.67 to 103.99 


Computer-assisted instruction 


18 


70.92 


64.26 


58.36 to 83.48 



Note . PTT = Pre-service Teacher Trainers 
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Multivariate Tests of Significance 



KotelHng*s multivariate test of significance was performed on the pre-service training 
activities. Hotelling^s test simultaneously considered the mean weights of all training 
activities for the three subgroups of PTT on three variables - the years that the teacher trainer 
has worked in his current institution, the percent of time spent by the teacher trainer on 
teaching, and the institution's enrollment size - and determined whether any statistically 
significant differences existed. Table 38 shows that no statistically significant differences 
occurred for the pre-service training activities' mean weights when the teacher trainers were 
subgrouped on the variables of percent of time spent on teaching and the institution's 
enrollment size. This two factor design (percent of time spent on teaching by institutional 
enrollment size) permitted a simultaneous test of the two factors for a possible interaction 
effect. 



Table 38 

Percent gflim^ Teaching bx Enrollment Qjz&l Multivariate Tests of Significance for Ptp- 
service Training Activities (£ = 4, M = 6 1/2, a = 37 ) 



Test Name Value Exact F Hypoth. DF Error DF p -value 



Hotellings .93282 .96521 72.00 298.00 .560 



Table 39 includes the results of the Hotelling s multivariate test of significance on all 
training activities for the three subgroups of PTT on the two variables, respondent's number of 
years in current position by the institution's enrollment size. No statistically significant 
differences were calculated. 



Table 39 

Y^ar^ in Current Position bv Enrollment Si?;^; Multivariate Tests of Significance fo]- P|-p, 
service Training Activities (£ = 4, M = 6 1/2, n = 37 ) 



Test Name 


Value 


Exact F 


Hypoth. DF 


Error DF 


p -value 


Hotellings 


.69508 


.71922 


72.00 


298.00 


.953 
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Tables 40, 41, and 42 include the results of the Hotellings multivariate tests of 
significance for the three subgroups of PTT on each of the three variables taken singly: 
percent of time spent on teaching, institution's enrollment size, and respondent's number of 
years in current position. No statistically significant differences were calculated. 



Table 40 

Percent of Time Teaching: Multivariflte Tests of Si ynifinance for Pre-service Training 
Activities (£ = 2, M = 7 1/2, a = 37 ) 



Test Name 



Value 



Exact F Hypoth. DF Error DF p -value 



Hotellings 



.45204 



.94176 



36.00 



150.00 



.569 



Table 41 

Enrollment Sk^l Multivariate Tests of Significance for Pre-service Training Activities 
(S = 2,M=71/2,n = 37) 



Test Name 



Value 



Exact F Hypoth. DF Error DF p -value 



Hotellings .41036 



.85493 



36.00 



150.00 



.703 
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Table 42 

Years ia Current Position: Multivariate Tests of Significancft for Pre-servicft Training 
Activities (S = 2, M = 7 1/2, n = 37 ) 



Test Name 


Value 


Exact F 


Hypoth, DF 


Error DF 


p -value 


Hotellings 


,38189 


.79560 


36.00 


150,00 


.786 



Since the multivariate tests of significance indicated no statistically significant 
differences among the subgroups of pre-service teacher trainers, no further post hoc tests were 
performed. 



Discussion 



As in the other survey reports of this series, this section will enumerate the limitations of 
this survey's sample size, return rate, and instrumentation; provide a brief summary and 
conclusions; and make recommendations regarding policy and future research. 

The first three surveys (Elicitation, Ranking, and Weighting) dealt with the 
identification and ranking in importance of the desirable attributes of special education 
programs. The Elicitation Survey (Survey 1) resulted in categorizations of 40 special 
education program attributes, 28 special education program activities, 23 special education 
teacher attributes, and 18 pre-service teacher training activities; however, the listings were not 
ranked. While the Elicitation Survey provided extensive information, that information 
comprised four sets of nominal categories. The Ranking Survey (Survey 2) involved 16 
professionals who ranked the 40 special education program attributes and 23 special education 
teacher attributes. The ten highest-ranked attributes from the Ranking Survey were listed in 
the Weighting Survey (Survey 3), in which DOSE, SOS and PTT weighted the program 
attributes and teacher attributes. 

The Implementation Survey for DOSE and SOS (Survey 4) generated utility 
measurements for special education program activities as they impact on program attributes. 
Survey 5, the Implementation Survey for PTT provided an opportunity to list a ranking of pre- 
service training activities as they enhance or otherwise influence the desirable attributes of 
special education teachers. Hence, the results of this fifth survey are net directly comparable to 
the previous four surveys' responses, since the focus shifted, from identifying and ranking the 
attributes of quality special education teachers, to the degree of influence that pre-service 
training activities have upon the aforementioned teacher attributes. The Implementation 
Survey for PTT generated utility measurements for pre-service training activities as they 
impact on special education teacher attributes. 
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Two particular aspects of the survey responses are of interest. The first aspect is the 
ranking of ^^ie activities themselves in their order of perceived utility. The second aspect is 
that subgrouping the 103 respondents along three different variables did not reveal a 
differential set of responses. No statistically significant differences were calculated. This 
latter finding suggests that these training activities are evaluated comparably regardless of 
the individual's time spent in teaching, the length of time at the institution, or the enrollment 
size of the institution. This common perspective provides an important foundation as one 
examines the training of teachers. We would have assumed that the variation in training 
programs' emphases would have yielded differences. In addition, even though institutions 
train teachers to conform to their respective certification requirements, which vary across 
states, the trainers still value the same kinds of training content and activities to meet these 
varied requirements. 

On the positive side, this similarity may speak to the robustness of teacher training. For 
example, the activity of student teaching has the greatest utility of all preservice training 
activities. This utility is noted across the states with their varied certification requirements - 
with their varied distinctions of the substance, purpose, and value of education (Cornbleth, 
1986). One might question whether such uniformity actually has demonstrated the apparent 
value attributed to it, or rather as Cornbleth (1986) suggests, a ritual has been adopted without 
further consideration. On the other hand, one would also want to examine and describe the 
training activities carefully. This examination is needed to assess the actual degree of 
comparability in the operational steps and procedures which give the training activities their 
substance. One might expect that many variations exist among the teacher training activities. 

Structure of teacher preparation. Pugach (1987) reviewed publications of selected authors 
writing about needed reforms in teacher preparation in regular education. She noted that most 
authors would deemphasize the university's role and place greater emphasis on field-based 
instruction. An interesting and important datum is learning if regular teacher educators 
perceive comparable utility to their most valued teacher training activities. That is, do teacher 
trainers in regular education perceive "Student teaching activities," "Modeling and 
demonstrations," "Clinical teaching," "Observational activities," and "Simulations" as the 
five training activities having the greatest value for developing the desired characteristics 
among general education teachers? Given the structure and content of most teacher education 
programs, such an outcome might be expected. 

An important consideration is whether such consistency among trainers exists because 
of an assumed linkage to the particular instructional approach being advocated for teachers. 
For example, do "direct instruction" and "learning strategies," as two different instructional 
methodologies, require the same kinds of training activities? Do "student teaching activities" 
work equally well regardless of the trainer's instructional methodology? Alternatively, 
"student teaching activities" may have become institutionalized without a serious 
consideration of its fit with the particular goals and content of the training. 

Limitations 

Although the Implementation Survey for PTT involved 325 teacher trainers randomly 
chosen from a database of 640 special education staff members at institutions of higher 
education, the usual constraints apply regarding precipitate inferral of generalizations 
without due regard for the limitations of the population sample, the return rate, or the survey 
instrument itself. 

The major issue in these results concerns the replicability of the findings. Replication is 
an issue on two counts. The first threat to the findings was the response rate. Of the 325 surveys 
sent out, 121 or 37.23% were returned. This return rate occurred despite efforts to elicit strong 
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participation and use of multiple mailings. The second threat was whether the particular 
instramentation was inappropriate for the desired responses. Both issues could be addressed 
in follow-up studies examining similar research questions. 



Implicatio ns for Polinv Dirftctivfts 



Teacher education has implications across a variety of audiences, including the 
training institutions, state and local education agencies who certify and employ teachers, and 
the public who purchase the teachers' services. The following recommendations address ' 
several policy concerns. 

1) Adopt a mec h n nisni for timely comnnmication between SEIA, LEA, and hi^er 
education. The findings suggest that LEAs have a major role for effectively 
communicating their desired qualities for a teaching staff to higher education. Quite 
likely the teacher training lobby representing and residing in colleges and universities 
is not likely to be changed in the near future in spite of some reformers" protestations to 
the contrary. The teacher training institutions have demonstrated a long history during 
which those teacher training models have become entrenched in their missions, goals, 
administrative structures, course work emphases, and experiences. Similarly, these ' 
training models vary with the particular campus or college, which further complicates 
any efforts of national or even local change. Thus, the LEAs" needs need to be 
communicated effectively. At a local level those efforts might be focused on the specific 
nigher education institutions from which most entry level teachers are hired. Similarly 
the teacher trainers need to provide a databased foundation for their current focus of 
teacher training attributes and corresponding activities. The results of polling teachers 
(Elam, 1989) suggest that teachers feel that they are in the best position for determining 
the appropriate instructional goals and curriculum of their respective districts. Clearly 
this finding differs from practice and poses an interesting point for further discussions. 

2) Integrate school districts' ed" . ational model and hi^^ier education's instructional 
models. A distinction is dr between an educational model in a school district and an 
instructional model preser.ted by a teacher training program of how students learn A 
district's educational model exists in a district in its assumptions, policies, and 
practices. The educational system incorporates those elements in providing for 
students' education. The teacher training program makes similar assumptions but 
independent of any particular district's situation and incorporates those assumptions 
into a model of student learning. LEAs would benefit and likely value a model of 
teaching that would compare differing instructional methodologies, e.g., cognitive 
behavioral, developmental, and holistic. 

Dimensions on which these instructional methodologies differ can be identified 
(e.g., Marshall, 1988) for the purpose of forming multiple comparisons. However 
comparing one instructional model with another is limited. A needed cross-reference is 
for LEAs to be able to describe their own goals, administrative structures role 
expectations, and resources from a perspective that would help distinguish the utility of 
the different instructional approaches. In this manner the two models, that is the teacher 
training instructional model and the LEA's educational model, could be analyzed and 
integrated through better planning. As Clark (1984) suggested, this planning needs 
careful consideration of the distinctions between secondary and elementary levels of 
special education. Similarly, such a matrix would provide a basis for local reforms 
which, in turn, could then impact training (Cornbleth, 1986). 
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Implications for Future Research 

The research results of this survey have implications for subsequent research as well. 
Certainly the policy issues addressed above should be accompanied with research, but 
additional questions lacking such direct linkages to policy can also be identified. The 
following material provides several such alternatives. 

(1) Describe the content of traininif pxtigrams and its actual integration into varied 
training experiences. An interesting and important question is evaluating the current 
training curriculum at the nation's teacher training institutions for the degree to which 
they utilize these varied training activities. Again, the respondents placed greater 
emphasis on those training experiences which required higher levels of student activity 
(e.g., student teaching and modeling) versus experiences which required less active 
doing (e.g., lecture coursework and use of videotapes and media). Is this distinction 
actually apparent in the teacher training sequence? 

In addition, if teacher training programs can be considered as espousing a particular 
instructional philosophy (e.g., direct instruction, community based instruction, career 
education, and learning strategies,) do the training programs differ in their 
instructional experiences offered to students intending to become teachers? Second, to 
what degree do the training programs actually adopt those same methodologies in the 
training sequence. For example, for teachers being taxight cognitive perspectives of 
learning, is this cognitive psychology foundation evidenced in the students' actual 
training experiences? Such an infusion of the particular perspective might be 
particularly helpful in deepening the students' appreciation and knowledge of the 
instructional approach. A potentially valuable description would be to contrast teacher 
training programs on their instructional models as well as the integration of that model 
in the variety of their training activities. 

(2) Describe decision-making guidelines among trainers. When the resuLs of the 
Ranking Survey and this survey are examined together, an interesting issue is 
apparent. School districts differ on a number of important dimensions, such as the 
degree of autonomy teachers have in implementing a particular curricular approach, 
e.g., community-based instruction. However, the challenge is that the training 
institutions may provide a specialized training experience that orients teachers to 
different instructional skills. How do trainers come to make those decisions and how 
could those trainers be best influenced to change? Or in other words, what is the criterion 
guiding the decision-making of trainers? McLaughlin, Valdivieso, Spence, and Fuller 
(1988) have suggested that "teacher training is being driven by forces such as 
certification policies that are largely out of the control of the profession and needs of local 
school districts. 

Summarv and Conclusions 

The Implementation Survey for FIT was the final phase of the multi-attribute utility 
measurement procedure adapted to seek a numerical value for the degree to which a pre- 
service teacher training activity influences attributes of successful special education teachers. 
Previous surveys, specifically, the Elicitation Survey, the Ranking Survey, and the 
Weighting Survey, were essential to this Implementation Survey. 

A matrix was created in which the mean weights of the teacher attributes, obtained from 
the Weighting Survey, made up the columns. The pre-service training activities represented 
the matrix's rows. Individual cells held the product of the teacher attribute's weight by the 
location measure ((viz., the ranking given by the PTT, ranging from 1 (low) to 6 (high)) 
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assigned by the respondent The products were summed across the columns to determine the 
utility measurement of a given activity. The results were summed across all the respondents 
within the group, to generate the utiHties for each of the training activities. 

The five pre-service training activities with the highest utility measurements, as rated 
by the PTT (see Table 37) were: "Student teaching," "Modeling and demonstrations," 
"Clinical teaching," "Observational activities," and "Simulations." 

The five pre-service training activities with the lowest utility measurements, as rated by 
the PTT were: "Computer-assisted instruction," "Research experiences," "In-service 
activities," "Group experiences," and "Individual advisement and conferences." 

The PTT respondents were sub-grouped according to their responses on three 
characteristics: respondent's number of years in current position, respondent's percent of 
time spent in teaching, and the institution's enrollment size. Analyses of variance were 
performed on the multi-attribute utility measurements for pre-service training activities 
generated by the three sub-groups of PTT. No significant differences were found in the 
responses of the three sub-groups of PTT. That is, the response pattern was similar across the 
three characteristics. 

In conclusion a distinctive set of training activities were identified by the respondents 
for preparing teachers to meet a desired set of attributes. "Student teaching activities" were 
judged as most relevant to the preparation of those skills and content areas. Overall, the higher 
the level of activity, the greater utility was judged among the various alternative instructional 
experiences. While "learn by doing" may be the consensus, the unresolved issues are in 
determining the appropriate mix of these options and defining competencies shared among 
teachers, the public in general, SEAs, and LEAs. 
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High School Special Education Teacher Attributes 



Directions 

Complete the following questions by referencing your p r e - 
service training program for high school special education 
teachers of students with mild to moderate handicaps. 

Circle the number which best represents your judgment. If a 
program activity minimally applies to the attribute, circle 
If the activity highly applies to the attribute, circle "6." 
Values between 1 and 6 allow you to specify the degree to which 
the activity applies. If the activity is not available in your 
program, circle "NA," meaning "not available." 

Example 

Suppose one of the important attributes of a physician is 
"accurate diagnoses." In medical school training, assume that 
among the many training activities are (a) lecture classes, 
(b) laboratory work, and (c) hospital visits. 

Question: To what extent does each of the following 

training activities develop a physician's diagnostic 
accuracy ? 

Low High Training Activity 

NA 1 2 (3) A 5 6 (a) lecture classes 

NA 1 2 3 A 5 0 (b) laboratory work 

(na) 1 2 3 a 5 6 (c) hospital visits 

The lecture class activities provide information on 
diagnostic accuracy in about half of the classes, thus the rating 
of "3." "Laboratory work" is totally related to developing 
diagnostic accuracy, hence the rating of "6." Since "hospital 
visits" are not part of this medical school's training program, 
it was rated "NA," meaning "not available." 
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1, To what extent does each of the following training activities develop 
skills in working with people ? 



page 2 of 7 



(9) 





Training Activities 




Low 






High 






(a) 


Individual advisement or conferences 


NA 


1 


2 


J 


/, 
H 


5 


6 




(b) 


Curriculum development experiences 


NA 


1 


2 


3 


4 


5 


6 


(3) 




(c) 


On-going assessments 


NA 


1 


2 


3 


A 


5 


6 


(12) 


• 


(d) 


In-service activities 


NA 


1 


2 


3 


A 


5 


6 


(15) 




(e) 


Group experiences 


NA 


1 


2 


3 


4 


5 


6 


(16) 




(f) 


Lecture coursework 


NA 


1 


2 


3 


A 


5 


6 


(2) 


• 



2. To what extent does each of the following training activities teach 

skills in assessing outcomes ? (^0) 

Training Activities Low High 

(a) Computer-assisted instruction NA 1 2 3 4 5 6 (14) 

(b) Research experiences NA 1 2 3 4 5 6 (17) 

(c) Lecture coursework NA 1 2 3 4 5 6 (2) 

(d) On-going assessments NA 1 2 3 4 5 6 (12) 

(e) Simulations NA 1 2 3 4 5 6 (5) 

(f) Student teaching activities NA 1 2 3 4 5 6 (1) 

3. To what extent does each of the following training activities develop 

instructional skills? (2) 

Training Activities Low High 

(a) Curriculum development experiences 

(b) Videotape and media usage 

(c) Simulations 

(d) Research experiences 

(e) Formal and informal seminars 

(f) Large and small group discussions 



NA 


~2 


3 


4 


5 


6 


(3) 


NA 


1 2 


3 


A 


5 


6 


(6) 


NA 


1 2 


3 


A 


5 


6 


(5) 


NA 


1 2 


3 


4 


5 


6 


(17) 


NA 


1 2 


3 


4 


5 


6 


(4) 


NA 


1 2 


3 


4 


5 


6 


(11) 
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4. To what extent does each of the following training activities teach 

assessment skills for planning and instruction ? (15) 

Training Activities Low Hish 

(a) Lecture coursework \A 1 2 3 U 5 ^ (2) 

(b) Group experiences S'A 1 2 3 4 5 6 (i6) 

(c) Videotape and media usage NA 1 2 3 4 5 6 

(d) Oral presentations by students NA 1 2 3 4 5 6 

(e) In-service activities NA 1 2 3 4 5 6 (15) 



(f) Observational activities NA 1 2 3 4 5 6 



(6) 
(9) 



(8) 

5. To what extent does each of the following training activities develop 

skills in working cooperatively with s taff and administration ? (8) 

Training Activities Low High 

(a) Large and small group discussions NA 1 2 3 4 5 6 (n) 

(b) Oral presentations by students NA 1 2 3 4 5 6 

(c) Formal and informal seminars NA 1 2 3 4 5 6 

(d) Observational activities NA 1 2 3 4 5 6 

(e) On-going assessments NA 1 2 3 4 5 6 

(f) Research experiences NA 1 2 3 4 5 6 

6. To what extent does each of the following training activities enhance 

knowledge of post - secondary transition ? 

Training Activities Low High 

(a) Clinical teaching NA 1 2 3 4 5 6 



(9) 

(4) 

(8) 

(12) 

(17) 

(4) 



(7) 

(b) Case study presentations NA 1 2 3 4 5 6 (18) 

(c) Oral presentations by students NA 1 2 3 4 5 6 

(d) Student teaching activities NA 1 2 3 4 5 6 

(e) Individual advisement or conferences NA 1 2 3 4 5 6 

(f) Curriculum development experiences NA 1 2 3 4 5 6 



(9) 
(1) 
(13) 
(3) 
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7. To what extent does each of the following training 
curriculum and instructional planning skills ? 



Training Activities 

(a) Group experiences 

(b) Oral presentations by students 

(c) Lecture coursework 

(d) Large and small group discussions 

(e) In-service activities 

(f) Curriculum development experiences 



LOW 



NA 1 

NA 1 

NA 1 

NA 1 

NA 1 

NA 1 



2 
2 
2 
2 
2 



activities teach 

High 
3 4 5 6 

3 4 5 6 

3 4 5 6 

3 4 5 6 

3 4 5 6 

3 4 5 6 

activities develop 



8. To what extent does each of the following training 

classroom organization skills ? 

Training Activities 

(a) Large and small group discussions 

(b) Clinical teach-ng 

(c) Computer-assisted instruction 

(d) Formal and informal seminars 

(e) Videotape and media usage 

(f) Curriculum development experiences 

9. To what extent does each of the following training activities develop 

behavior management skills ? 



Training Activities 

(a) Large and small group discussions 

(b) Case study presentations 

(c) Lecture coursework 

(d) Computer-assisted instruction 

(e) On-going assessments 

(f) Modeling and demonstrations 



Low 

NA 1 2 

NA 1 2 

NA 1 2 

NA 1 2 

NA 1 2 

NA 1 2 



High 

3 4 5 6 

3 4 5 6 

3 4 5 6 

3 4 5 6 

3 4 5 6 

3 4 5 6 



(1) 

(16) 

(9) 

(2) 

(11) 

(15) 

(3) 

(5) 



NA 


Low 
1 


2 


3 


4 


High 
5 6 


(11) 


NA 


1 


2 


3 


4 


5 


6 


(7) 


NA 


1 


2 


3 


4 


5 


6 


(14) 


NA 


1 


2 


3 


4 


5 


6 


(4) 


NA 


1 


2 


3 


4 


5 


6 


(6) 


NA 


1 


2 


3 


4 


5 


6 


(3) 



(7) 

(11) 
(18) 
(2) 
(14) 

(12) 
(10) 
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10. To what extent does each of the following training activities enhance 

knowledge of vocational and career -education ? (22) 



Training Activities 
(a) Research experiences 


NA 


Lov, 
1 


1 

o 


3 


4 


Hi 
5 


8h 
6 


(17) 


(b) In-service activities 


NA 


1 


2 


3 




5 


6 


(15) 


(c) Observational activities 


NA 


1 


2 


3 


4 


5 


6 


(8) 


(d) Videotape and media usage 


NA 


1 


2 


3 


4 


5 


6 


(6) 


(e) Large and small group discussions 


NA 


1 


2 


3 


4 


5 


6 


(11) 


(f) Curriculum development experiences 


NA 


1 


2 


3 


4 


5 


6 


(3) 
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Teacher Trainers ' Inf oraa tion 

ase fill in or check items as appropriate. 



Respondent characteristics 

1. What was the last degree you earned? (Please check.) 





B. A./B.S. 


M.A. 


/M.S. Ed . Spec . 


Ph.D./Ed-D. 


• 


nlldu / die 

education? 


V n 1 1 T* 
J U U i 


area(s) of specialization in special 


A. 


M.R. 


F. 


H.I. /Deaf K. 


Early Child. Hand. 


B. 


L.D. 


G. 


V.I. /Blind L. 


Diag . / Assess . 


C. 


B.D. /E.D. 


H. 


Lang. /Comm. Dis. M, 


Career /Voc . Ed • 


D. 


SpEd . Ad . 


I . 


Phys. Hand . N. 


Generic/Cross Categ. 


E. 


Gifted 


J. 


Multiple Hand. 0. 


Other: 




If you checked 


more than one item above, 


write the letter tha 



represents your primary area of specialization: 

4. What is the age level of your specialization emphasis? 

(Please check one.) 

Early childhood Elementary Secondary Post -sec. 

5. What is your academic rank? (Please check.) 

Instructor Assist. Professor Associate Professor 

F ull Professor 0 ther (Describe) 

6. How many years have you been at the current college/university? 



7. Please record the percentages of time you give to each area. 

(Total equals 100%.) 

t e a c h i n g a dministration r e s e a r c h 

service other (Describe) 
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Program characteristics 

8, Number of students in the college/university: 

2,500 or less 10,001 - 15,000 25,001 - 30,000 

2,501 - 5,000 15,001 - 20,000 30,001 - 35,000 

5,001 10,000 20,001 - 25,000 35.001 or more 

9. Does your state have certification requirements for the secondary 
level which are separate from the elementary level (i.e., K - 6) 
for teachers of students with mild to moderate handicaps? 

Yes No 



10, In the requirements at the secondary level for teachers of the 
mild to moderately handicapped, does your training progra m 
require student teaching or practica in a high school setting? 

Yes No 



11. Age level(s) for which you train special education teachers: 

EarlyChildhood Elementary ^ Secondary Pos t~secondar\ 

12. Including yourself, how many faculty members (those with a rank 
of at least assistant professor) teach preservice courses speci- 
fically targeted for secondary level teachers of students with 
mild to moderate handicaps? 



13. Are you interested in participating in a special interest group 

of the CEC-TED focusing on secondary and post-secondary teacher 
trainers? 

Yes No 

14. Please correct any incorrect information on the attached mailing 

label : 



Please use the enclosed envelope and return this survey to us by 
May 15, 1987 (Friday). Thank you. 

If you would like a summary of our results, please w-ite your name 
and address on the back of the return envelope. 
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Synopsis and Conclusions 



In this last section we have chosen to offer both an integrated review of the different 
surveys* results and a broadened discussion regarding issues from the project. In these few 
remaining pages, we review the issues initially considered important in proposing this 
research, summarize the findings from the survey methodology, and integrate the findings 
with the two other phases of the National High School Project, the survey of state departments of 
education (Bodner, Clark, and Mellard, 1987) and a quaUtative study of four school districts' 
goals, current practices, and barriers to the delivery of special education programs at the 
secondary level (Knowlton & Clark, 1989). Integration of these three segments provides an 
important description of the current efforts in education from multiple levels within that 
system, e.g., state level, local level, and pre-service teacher training level. In summarizing 
our data and perspectives we offer two sets of principles for directing reform. The first set 
focuses on instructional reform in secondary level special education. The second set focuses 
on reforms in pre-service teacher training The principles are intended to guide discussions 
for improving students* educational outcomes, a topic whic> appears most critical. 

Like others (Hagerty & Abramson, 1987; Johnson et al., 1987) we believe that an 
important, and perhaps most important, first step to effective programs is to have a clearly 
articulated statement of values. This study was an opportunity for selected stakeholder groups 
to identify and examine their values regarding high school special education programs for 
students with mild to moderate disabilities and the pre-service training programs for teachers 
teaching in such settings. That is, what are the important characteristics on which such 
programs and staffs should be evaluated? At a very general level, we were interested in 
determining the attributes of a program which were important to evaluate so a qualitative 
judgment could be made about that program, i.e., how good the particular program was. One 
important assumption guiding this work was that such qualitative judgments varied with 
particular perspectives; second, that no single attribute should serve as the criterion for 
evaluating a program's qualities. Just as multiple attributes are required in determining a 
student's eligibility for special education's services, programs providing those services 
should be evaluated on multiple attributes. The opinions about a program's desired attributes 
were expected to vary depending on membership in a particular stakeholder group. Tvv'O 
groups of district level administrators, superintendents of schools and directors of special 
education, were chosen for inquiry. A third group, pre-service teacher trainers, was added 
because of the apparent significant role they have on local classrooms, and yet are not part of 
the district or even the state level governance of schools. This unique position of teacher 
trainers suggested that their viewpoints on the desired quaUties of both programs and teaching 
staflT should be described and compared to those views of district level administrators. 

The study was conducted at a time when many efforts were occurring to reform schools 
in general and to reshape the philosophy of special education. In general, school directed 
reforms have incorporated recommendations from numerous commissions and authors, 
though their perspectives and recommendations are not compatible. The National 
Commission on Excellence in Education was perhaps the most famous with its report, A Nation 
At Risk: The Tmnerative for Educfltional Reform. Adler (1982), Boyer (1983), Goodlad (1984) 
and Sizer (1984) each offered their views of reforms needed in the public schools, specifically 
the high school. The common theme among these efforts is that of improving the quality, the 
excellence, of schools as reflected in the skills of their graduates. A comparison of these 
authors' works, however, indicate that excellence is not a unitary characteristic, nor does a 
consensus exist on how to define it. 
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The directives for improving excellence that come from most advocates are not 
necessarily compatible with improving the educational opportunities for those students who are 
only marginally successful in schools. Minority students, students from lower socio- 
economic segments, and students with disabilities are not considered specifically in the 
planned reforms (Edgar, 1987; Moran, 1984). In the absence of an inclusive planning model 
for reform, students with such characteristics are less likely to benefit. For example, one of the 
major thrusts in special education has been increasing the probability of students making a 
successful transition to independent living and employment from high school. These two 
desired outcomes require a specific curricular focus, perhaps longer, with varied instructional 
opportunities and in varied settings than traditionally associated with high school. Since most 
all of the high school reforms, however, seek to narrow the coursework options and increase the 
standards for graduation, these students with mild to moderate disabilities are even less 
likely to receive suitable educational and vocational training experiences to realize these 
outcomes. These outcomes would not be realistically expected with a three or four year 
emphasis at the secondary -level on basic academic skills (Knowlton & Clark, 1987). This 
example illustrates the complicated and often competing values in establishing policy to direct 
educational practices. 

The linkage between values and practices is important. We have assumed that a 
school's practices are based on agreed values. That is, the school's practices are directed from 
a foundation of shared values. In our research we chose to examine the relationship of values 
and practices in two areas: (1) districts' high school level special education programs for 
students with mild to moderate disabilities and (2) preservice training programs for 
secondary special education instructional staff. Each program has multiple objectives and 
multiple activities towards realizing those objectives. The objectives reflect th(. values or the 
mission of the program. We might understand these objectives as multiple statements of 
purpose. For example, a special education program exists to accomplish several different 
goals. Similarly, preservice training programs have multiple objectives, perhaps 
preeminently, to train effective instructional staff. A goal of our research was to identify those 
values considered important to the respective programs. In our research, these value 
statements were described as attributes. That is, the values or attributes which are important to 
examine to understand the quality of a program. 

As suggested above, we believe that programs, such as special education programs in 
high schools or preservice training programs, are intended to address multiple attributes. 
That is, the progi-ams are designed to satisfy several dimensions of quality. The attributes, 
however, are only part of understanding a program. These attributes are addressed through 
activities. This relationship of attributes and activities might be understood by considering 
that if we desire to characterize our program by (a) acquisition of basic academic skills 
(h) completion of the high school curriculum, and (c) strong community support, then a defined 
set of activities (e.g., x, y, and z) is more likely to be suitable than another set of activities. 
Thus, we would expect that a clear illustration of desired attributes could be paired with 
planned activities. The variations in the desired attributes among three respondent groups 
would also result in a change of emphasis in the planned activities. This relationship of 
desired attributes and corresponding activities has not been examined nationally. The results 
of our surveys yielded a set of attributes by each of the three groups. Our data provide three 
different groups' perspectives. Such a description is important if we are to understand cuiTent 
practice and plan meaningful reform. A national evaluation of such linkages is important if 
we are to agree to a national agenda for school raform and special education programs. This 
linkage of desired attributes and the activities in*:ended to reflect those attributes provides a 
valuable perspective on current practices. As a result of the research, the data provide the 
attributes and an estimate of how well the programs' activities enhance or reflect those 
attributes. 
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In the following section, important findings from the surveys are summarized and 
reviewed. In this review results from each of the five surveys are included in providing an 
integrated summary of information which might on first blush appear as quite disparate. We 
have organized the results into two broad categories. The first category represents 
information for which we have the greatest confidence and on which we feel policy and 
practice can be based. In the second category we have made comparisons with the results of the 
qualitative study (Knowlton and Clark, 1989). Both sets of results provide a basis for 
recommendations for further action in research, practice, and policy development. 
What Do Wi» Know Th«f W>> rKdn't Knnw? 

1 . Uniformity of shared peroeptions for desired qualities for secondaiy level special 
education programs. 

In our first survey, the Elicitation Survey, we asked respondents to list those attributes 
they considered important if one was to evaluate special education programs for students vdth 
mild to moderate handicaps at the secondary level. We were surprised by the uniformity 
evidenced in the responses of our three groups: directors of special education (DOSE) school 
superintendents (SOS), and pre-service teacher trainers (PTT). The ten most frequently cited 
attributes by the DOSE are presented in Table 43 along with the percentages of the SOS and PTT 
who included those same ten attributes. The commonality was surprising because of the very 
different responsibilities each group has regarding the local special education programs at the 
secondary level. Those varied responsibilities provide different opportunities for discussions 
and activities with the programs. In the Elicitation Survey the most desired attributes 
categorized from the responses concerned program characteristics, e.g. provided 
mdividualized, appropriate instruction, was supported and integrated with regular education 
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had the support of the staff, parents, and community, and had an effective staff. While high 
school completion was an important outcome to the DOSE and SOS, the VTT assigned "Life 
Skills Curriculum" the equivalent rank and a much lower rank to high school completion. 
Our respondents placed less emphasis on students* accomplishments than on how they would 
like to characterize programs. We refer to this perspective as a Trogjam characteristics" 
orientation. We conclude that an outcomes orientation had limited meaning to our 
respondents. Prom their perspectives, the quality program was one which looked 
organizationally and philosophically like a good program. 

On the other hand, we might speculate that the responses eUcited were a function of our 
phrasing on the survey. We would predict that if our respondents had been asked a question 
such as "What are the most important goals for a secondary level progjani for students with 
mild to moderate handicaps?" the responses would have been quite comparable for the three 
groups. We believe that the desired goals or outcomes are similar, but that those outcomes do 
not translate into a direction for operating the programs. Rather, operating the programs is 
more closely tied to the types of program characteristics listed above. Our assumption is that, 
in fact, an "outcomes orientation" is quite different from a "program characteristics" 
orientation. In the former the orientation shifts to an emphasis on the knowledge, skills, or 
abilities of the students. The program's values are described from the student's attainments 
and characteristics of the programs are considered as having a mediating role secondary to 
the students' accomplishments. The proverb that "you can't tell a book by its cover" applies 
well to our point. Programs may look good from a variety of vantage points on the surface, but 
the most important criterion is the students' outcomes from participating in those programs. 

2. Uniformity of shared perc^tions for desired qualities of instructional staff in the 
secondary level special education programs. 

In the Elicitation Survey, respondents also were asked to indicate the desired qualities of 
the instructional staff. The three groups' shared perspectives were also evident in the desired 
attributes for instructional staff in that personal characteristics and training experiences 
were among the most frequently cited attributes. Specific instructional skills were mentioned 
frequently also (e.g., curriculum and instructional planning, instructional skills, classroom 
organization skills, behavior management skills, and consultation skills). The ten most 
frequently cited attributes by the DOSE are included in Table 44 along with the percentages of 
the two other responding groups for the same concept. 
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Knowledge of specific curricular content was mentioned infrequently by the 
respondents. The uniformity of desired instructors' skills, rather than curricular content, 
suggests that content knowledge is seen fironx a different, less valued vantage. Perhaps the 
perspective among the respondents is that if the high school teachers have generic instructional 
skills, their breadth and depth of content knowledge is less critically important. Such a view 
would suggest the school's adopted curriculum is well enough defined that advance 
preparation or background knowledge plays a less ciitical role. We challenge that 
assumption on the basis of the long established emphasis in secondary education on subject 
matter content knowledge of teachers. Instructional skills are important, but we were 
surprised y/ith the degree to which those skills were so frequently cited over appropriate content 
or procedural knowledge. From our perspective the issue is one of relative difference, 
meaning that both content knowledge and instructional skills are important The emphasis 
was placed too heavily on the instructional skills rather than content or curricular knowledge. 
Content knowledge is particularly important if the special education program is viewed as 
providing the majority of the instruction in particular areas of academics or vocational 
training. Similarly, if the special education program is viewed as supplementing instruction 
offered in mainstream programs, content knowledge is critical for providing needed 
elaboration or enrichment Seemingly, improved quality of instruction places a greater 
burden on the special education staff who feel that the uniqueness of special education is in 
providing alternative instructional methods and curriculum than the mainstream provides 
As several authors have suggested, current special education lacks broad support because the 
cumulative effects are minimal (e.g., Edgar, 1987; Stainback & Stainback, 1984; Reynolds. 
Wang, & Walberg, 1987). » ^ . 

3, Uniformity of wei^ts assigned to program attributes and instructional staff 
attributes* 



The respondents to the third survey pro\nded weights to program and staff attributes The 
weights represent a ratio of the importance assigned by the DOSE, SOS, and PTT to ten desired 
attributes of programs and of teachers. These weights are rank ordered and presented in 
Table 45 for the program attributes and Table 46 for the teacher attributes. The left column 
includes the attribute statement. To the right of the attribute statement are two columns for each 
of the responding groups (i.e., DOSE, SOS, and PTT). The columns contain the numerical 
ranks (1 = the highest rank) and the grorps' mean weights assigned to the particular attribute 
Ihe higher the mean weight, the greater importance assigned to the particular attribute for 
judging the quality of the special education program (or teacher). 

Two aspects of these data are significant. First, the three groups of respondents had veiy 
high intercorrelations among their weights. For the program attributes the intercorrelation 
was .94 and for staff attributes the intercorrelation was .93. These correlations numerically 
indicate the shared perceptions among the three groups. The groups assigned the attributes a 
similar rank in their ordering of importance. All three groups assigned their two highest 
weights to the same program attributes: "Effective staff' and "Individualized, appropriate 
mstruction. Interestingly, while "Effective stafP was weighted so heavily here, this 
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attribute was infrequently cited in the open-ended format of the Elicitation Survey. (See Table 
43 above.) The shift in emphasis raises several questions about the groups' perspectives and 
their robustness. Uniformity was evident in the most valued staff attribute. All three groups 
assigned their highest weighting to the same attribute, Instructional skills," which had 
received frequent mention in the Elicitation Survey. 

The second aspect of these data is the similarity in the magnitude of the assigned 
weights. For the top five weighted program attributes of the SOS and PIT, the mean weights 
were of comparable value across the groups. Inspection of the data indicates that these 
attributes are considered comparably by the groups and that they weighted them similarly in 
importance. The ratio weighting procedures were a means of capturing the importance 
assigned to the respective attributes. For each responding group tfie top two program attributes 
were at least twice as important as the last two attributes. The significance of these weights is 
the heavy emphasis given to the quality of the staff as defining the program and that "Post- 
secondary transition curriculum" was least important. For the teacher attributes, the top two 
attributes were considered twice as important as the last two attributes, but the groups differed 
in their assigned weights. That is, the mean weights were reliably different. These 
differences were reflected in the statistically significant mean comparisons calculated with 
the Scheff(§ tests. We are uncertain, however, how these apparent differences would translate 
into differences of the goals or day-to-day activities. 

4 . Unifbrmity of shared peroeptioTis about pre-servioe teacher training activities* 

Teacher training activities appear to have a formula approach. Our reference to a 
formula is that the respondents were remarkably consistent in the value they attached to 
specific training activities. As we planned analyses of responses from PTT, we envisioned 
that both institutional factors, such as enrollment size, or specific characteristics of the teacher 
trainers, such as percent of time teaching or length of time at the institution, would influence 
the value attached to different pre- service training activities. No differences were noted in our 
analyses. 

Given a defined set of desired teacher attributes, the respondents uniformly agreed on the 
appropriate training activities. The final ranking of teacher training activities is included 
in Table 47. This ranking was based on responses to the fifth survey, which elicited utility 
measurements from PTT. Differences at their institutions or in their own perspectives did not 
result in varied responses. The background descriptors did little to explain the responses. We 
were left with the question whether institutional factors and professional background 
differences truly have little or no impact on their views about teacher training activities. 
Could it be that the traditional approach to teacher training that focuses on academic 
instructional skills dominates the respondent view simply because of the sheer numbers who 
identify with remedial and developmental academics as an extension of elementary school 
efforts? 
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Regardless, the stability of the findings leads us to believe that a strong consensus exists 
on appropriate training activities. We are uncertain about the basis of those beliefs supporting 
the training activities, but the support appears quite robust, 

Summarv This preceding capsule review was intended to provide an integrated, brief 
description of major findings fi-om our work in which we have the greatest confidence. From 
those findings and our understanding of current policy and practices, we next examine the 
similarities of our survey data to the case study information collected in the naturalistic 
inquiry. We then offer some further observations on specific topics in the following question 
and answer format, 

FiTiHiTiPfs 9^ur^ with tliA Q»»K»a W 

The first volume of findings from the National Study of High School Programs for 
Handicapped Youth in Transition (Knowlton & Clark, 1989) detailed results of a qualitative 
inquiry. The qualitative study was conceived as an independent, though complementary 
investigation to the surveys completed with directors of special education, superintendents of 
schools, and pre-service teacher trainers. The complementary intent was to provide a context 
in which the survey data might be interpreted. The naturalistic inquiry included four high 
school programs from different regions and settings of the country. The resulting case studies 
described high school special education programs and their contributions to the transition 
from school to adult life of students with mild to moderate disabilities. 

To integrate the two methodologies' results, a common fi-amework was established using 
the concepts of (1) progi-am and staff attributes and (2) program activities. Several 
confirmatory findings were noted among program and staff attributes. For example, 
"Effective Staff' was singled out by the survey respondents and in the case study reviews as the 
most important attribute to a quality program. The quality of the personr^el was of significant 
importance as indicated in the third survey's results. In the four case studies, an individual 
or group was identified as central to the successful operation of each program, which 
established the program's reputation. The case study data indicated how a program's success 
was influenced so strongly by an individual or corps of closely knit professionals. The case 
studies shared two other attributes identified as important characteristics of quality teachers in 
the surveys. Those two attributes were "Working cooperatively with staff and 
administration" and "Incorporating vocational/career education." These staff attributes 
commonly were cited as important in the four case studies. 

Additional program attributes identified in this study which were also cited in the case 
studies were "Administrative leadership and support," "Program support from staff, parents, 
business and community," and the programs' "Vocational/career orientation," Other 
attributes also distinguished the four exemplary programs but wc re not common across the 
sites. The degree of overiap between the quantitative surveys' findings and the case studies 
corroborate the importance of these values. 

We are encouraged by this cross-validation of attributes describing staff and programs. 
Such validation is important in understanding the generalization of the findings. The 
information obtained through the case studies, however, provided little insight about the 
relationship of the particular activities to specific attributes. The question we raised earlier 
about linkages of activities to enhancing specific program attributes is not resolved in the case 
study data. In a retrospecti-e review, that linkage appears to be weak. In these sites, 
interviewees did not elaborate on a clear description indicating that the activities in'the 
programs were tied explicitly to the qualities for which the programs are recognized. Such a 
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linkage warrants a closer evaluation in future research, both in surveys and case studies. 
Clearly, a paradigm is needed for helping to describe this relationship. 



Questions to address: How should refonn in special education be focused? 

The National High School Project was initiated to provide policy makers at the federal, 
state, and local levels with information to design and evaluate the quality of special education 
programs throiigh which youth with mild to moderate handicaps receive their education. As 
such, we believe that reforms should be directed by the outcomes of those educational 
experiences for individual students. 

While we concur with Mitchell and Encamation (1984) that the themes of efficiency, 
equity, and quality can be evidenced in education's pattern of reforms, the substantive effects 
have been narrowly defined. One might be able to argue successfiilly that none of these themes 
has altered the education system in a major way. As Combleth (1986) suggested, a ritual of 
educational reform seldom occurs that results in major changes in the system. Our 
recommendation is that reforms in education and in particular, special education, be directed 
by a shared understanding of its desired outcomes (Johnson et al., 1987). Educational reform 
should be directed at improving the outcomes of M those students, not just the capable majority. 

From our perspective and others (Gerber, 1988) accommodating students with disabilities 
in a regular education classroom is highly desirable as long as the students and classmates 
improve their learning ability and achievement. Members of the class should all benefit as 
evidenced by increased learner outcomes. Efforts directed in the transition movement would 
appear consistent with this intended outcome. The transition concept focuses on the students^ 
eventual successful integration into the environments apart from school. Our data suggested 
that the value of transition planning and monitoring received very limited understanding or 
acceptance among educators at the district or school level. We can speculate on several 
reasons for this finding. Transition planning seems unfamiliar to teachers, inconsistent 
with curricula, and since transition is directed towards specific students, that it doesn't fit well 
in settings in which the emphasis is more on teaching to the group rather than the strengths and 
weaknesses of mdividual students. A more cynical speculation might be that transition 
planning is ignored because teachers and districts are not evaluated on their efforts or success 
in that area. 



Our observations regarding the uniformity among our respondents on desired qualities 
of special education programs and instructional staff provides an interesting dilemma. 
Recall that the directors of special education, superintendents of schools and pre-service 
teacher trainers yielded quite similar rankings of desired program attributes and teacher 
attributes m both surveys one and three. (Table 45 provides a summary from the third survey.) 

On the one hand, the consistency speaks to a well grounded perspective on the mission 
structure, power base, and resources in special education. This perspective leads us to believe 
that the principles of the Education of the Handicapped Act (P.L. 94-142) have become 
operational in the field, at least in its rhetoric. The three groups have that shared perspective 
On the other hand, we would have expected greater c?ih: rences. For example, the professional 
literature read and conferences attended by the respc-:t:v-- groups are not likely similar. Their 
experiences with the programs are dissimilar. The superintendent of schools does not have the 
same concerns about a special education program as does the director of special education or a 
teacher trainer. Thus, based on differences of experiences and training we would have 
predicted differences in responses. Our inclination is to suggest that the findings represent 
accurately all three groups* perspectives. We are cautioned, however, to recall that the 
response rate was lower than desired and perhaps the uniformity merely reflects the special 
sample compieting the surveys. 
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As suggested we believe that more characteristics exist to distinguish the responding 
groups perspectives than supports the uniformity observed in the data. The lack of distinction 
suggests a lack of leadership for defining secondary special education s mission and the 
supporting factors at the secondary level that would improve the quality of high school special 
education programs. For example, "knowledge of transition" v;as identified ac a staff 
attribute and ranked high by our panel of experts (in the second survey), but ranked low by our 
responding groups and had the lowest assigned weight of desired teacher attributes (in survey 
three). While transition program and service funding recently have increased substantially 
in a national discussion (Rnowlton & Clark, 1987), the impact apparently is minimal at a 
local level on those individuals guiding special education services. Another finding 
exemplifying our concerns is the emphasis on administrative or compliance related 
attributes. In our view, legislative requirements establish minimums for administrative 
compliance, not evidence of quality. For example, providing individualized instruction is a 
minimum, the quality of the program should be evidenced in the outcomes of that instruction. 
The crux of that issue then turns on one's concept of the appropriate outcomes for students with 
mild to moderate disabilities in special education. Here, this issue is not just compliance, but 
rather a philosophical position as to what should be appropriate outcomes for individuals. 

Edgar (1987) provided a good context in which to consider the outcomes issue in his 
observation that "the truth is that secondary curriculum for special education students appears 
to have very little, if any, impact on their eventual adjustment to community life" (p. 560). In 
his plan, Edgar espoused an emphasis on functional skills, vocational skills, and 
independent living skills in the curriculum. Such a shift has the impact of truly 
distinguishing the goals of special education programs from the mainstream of a traditional 
academic high school curriculum. As a result, several consequences might be evidenced 
including: primary instruction for the students would be in special education classes, 
opportunities for interaction with the mainstream student would be different, graduation 
requirements would need reconsideration, and teacher preparation would have to be 
redefined. On the other hand, Edgar's observations appear supported by others 
recommendations (Benz & Halpem, 1987; Clark & Kolstoe, 1990; Halpem, 1979; Halpem & 
Benz, 1987; Kokaska & Brolin, 1985; McDonnel & Hardman, 1987; Thomas & Halloran, 
1987). Such views also would appear at odds with others* perspectives (Camine, Silbert, & 
Kameenui, 1990; Kameenui & Simmons, 1990; Polsgrove & McNeil, 1989; Shevin-Sapon, 
1987; Will, 1986). 

We believe that the program attributes, which were so consistently shared by the 
respondents, are insufficient. Second, we are concerned with the DOSE's and SOS' rankings 
of program activities. Our concern with the program attributes is that they provide little 
direction for instruction, or more importantly, the desired outcomes of instruction- For 
example, "Administrative leadership and support" was ranked as an important attribute of a 
high quality special education program. We have no quarrel with the concept that 
administrative leadership is important for all of education. Administrative leadership and 
support, however, are insufiScient. The focus, methods, and degree of leadership are more 
important considerations. The quality of the program should depend on the outcomes of 
instruction rather than the methods, administrative, or process characteristics of the program. 
In this perspective a clearly defined, agreed upon curricular sequence of content and goals 
should be evident and given greater emphasis. We agree with the statement made by Zigmond 
and Miller (1992): "There is no question that schools need to organize curricular offerings so 
that students have the opportunity to learn what they need to know to be adequately prepared for 
life after high school: for work, postsecondary training, and postsecondary education*' (p. 24). 

We expect a greater emphasis on students' special education outcomes in light of the 
national educational goals (White House, 1990) and assessment programs (National Center 
on Educational Outcomes, 1991) being considered as part of educational reforms. We might 
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speculate the degree to which these areas of reform woiild impact students with disabih*ties and, 
in particular, students at the secondary level. As we have pointed out, comparable reforms for 
school improvement or increased accountability have given little attention to the needs of 
students with disabilities or the potential impact. 

The rankings for program activities present several apparent conflicts. The 
respondents were asked to rate how well the combined set of ten program attributes, which were 
rated as the most important attributes, was facilitated or enhanced by that particular activity. 
The survey was intended to elicit their judgments of which program activity as implemented 
in their schools most enhanced the set of program attributes. Table 48 includes the five 
activities that had the highest utility ratings by the two groups of respondents. (Seven activities 
are actually included in the table because the DOSE and SOS included two different activities 
in their top five rankings. A review of the listing shows that three activities were common for 
the two groups. For the DOSE, "Inclusion in regular school activities," "Individualized 
instruction," and "Regular and adapted vocational education" were the three most valued 
activities. From the SOS's responses, "Basic skills instruction," "Inclusion in mainstream 
classes," and "Academic assistance for mainstream classes" were the three program 
activities with the highest utility ratings. 



Table 48 

Ranks of Top Five Special Education Program Activities 





DOSE (n 


= 155) 


SOS (n 


= 108) 


Program activity 


Rank 


Mean 


Rank 


Mean 


Inclusion in regular school activities 


1 


125.2 


7 


116.4 


Individualized instruction 


2 


125.1 


4 


122.6 


Regular and adapted vocational education 


3 


121.2 


10 


110.6 


Basic skills instruction 


4 


120.0 


1 


131.2 


Functional academics instruction 


5 


119.5 


5 


122.5 


Inclusion in mainstream classes 


6 


111.4 


2 


128.2 


Academic assistance for mainstream classes 


8 


107.0 


3 


122.8 



^ An emphasis for integration in regular class programs is evident in both the DOSE and 
SOS's responses, a concept consistent with the theme of the regular education initiative. The 
superintendents' responses are conceptually consistent with one another and have the 
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emphasis of specifying basic skills content. That content emphasis is similar to the direction 
of many reform efforts, and was similarly ranked by the DOSE. The apparent conflict is that 
"Regular and adapted vocational education" curriculum emphasized by the special education 
directors is very different from its emphasis by the school superintendents. The latter 
vocational education focus was ranked tenth by the SOS, which suggests great disparity about 
the curricular focus of the programs as related to the ten program attributes. Thus, these 
differences of perspective among districts* top administrators is very fundamental to the 
outcomes of secondary level special education. While we documented a remarkably high 
correspondence on desired attributes in earlier surveys, the daily activities' surveys indicate 
very different approaches to accomplishing those goals. Both groups linked greater 
participation in school-wide activities, but emphasize different curricular content, basic skills 
by the SOS and vocational education by the DOSE. 

What principles should guide the special education reforms? 

Much of the preceding material has advocated for a particular perspective regarding 
secondary level special education for students with mild to moderate handicaps. A theme 
commonly expressed in that perspective is the need for careful integration of desired goals 
with the content, instructional activities, and learning activities provided to secondary 
students with mild to moderate handicaps. That perspective is elaborated in a set of principles. 
The principles guiding our instructional model are not pedagogical. Our principles of interest 
in an instructional reform model are: 

(1) Curricular nlacement and ev aluation decisions are datahflSftH , 

In the short term, we would emphasize an increased attention to assessment activities 
to provide the database of students' performance. The assessments would be to evaluate 
the outcomes from the day's instructional and learning activities. The students' 
performance would be evaluated in terms of the level of mastery, and over time would 
be useful in evaluating students' educational placements. In the long term, we would 
expect that assessment would be better linked to the curriculum so that instruction and 
assessment are viewed as more integrated and used in curricular planning. 
Instructional and curricular nlanniny arP nnfi- o mes orienf^d with an annlipd fnmig 
While our data suggested a strong orientation towards inclusion of students into 
regular education's classes and activities and a basic skills orientation, we are 
uncertmn that the students' benefits would extend beyond the school setting. That is, the 
student's adjustment to school might improve, but we would expect little change in 
students' degree of community participation, independent functioning, and 
occupational success. Curricular planning should be focused on the application of 
academic skills to independent functioning and demonstrating social responsibility. 
In this way, the interested stakeholders should have a clear understanding of the 
results from the student's education. 

(3) Curricular goals arp locally ayr ped up on. 

The intended outcon.es of the curriculum should be locally agreed upon by multiple 
stakeholders. This issue includes both the specific content of the curriculum as well as 
the relative emphasis given to the different content. Since the data have repeatedly 
demonstrated that students with disabilities have relatively few options for either 
living independently or pursuing post-secondary education, the focus must shift to 
more specific goals which, from our perspective, must be approved by community 
representatives. We find little evidence to suggest that as the White House (1990) or 
schools adopt curriculum and higher standards in their search for excellence that 
students with disabilities will be considered. Thus, the local perspective is important 
and should reflect the needs of those students with mild to moderate disabilities We 
envision that if these students are considered, the multi-ethnic diversity will also be 
accommodated. 
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(4) The performance goals in special education mav at times be distinct from the 
mainstream of education. 

As suggested above, the high school students with mild to moderate disabilities may 
require different canicular emphasis and instructional methods (Edgar, 1992; Grerber, 
1983). The distinctness in these areas may translate int ) a need for students to 
demonstrate their knowledge and skills differently. 

(5) The performance assessment of students with disabilities mav be m odified or specially 
designed for their response capabilities. 

The competency assessment for the general student population may require a method of 
performing (e.g., timed test, handwritten text, or oral presentation) that's inappropriate 
for students with disabilities. Thus, the assessment process may change. This issue is 
certainly one that has been confronted as states have implemented competency-based 
assessment or exit testing and will be an extension of that accommodations. 

(6) A choice mav exist for students and their families between an acade mic and a 
functional course of studv in high srhool. 

Each course of study would have its own performance and outcome goals. 
Explanations of positive and negative consequences of those goals are understood by 
parents^ students, and educators and explained at initial consideration of any 
educational placement. We are uncertain that parents, and students in particular, 
fully appreciate the immediate and long-term consequences from education offered 
through current programs. The initial interest identification for special education 
services is appropriately oriented towards getting the students the kind of help they 
need or are perceived as needing. Our data suggest that administrative features of a 
special education program may receive more attention than instructional and 
curricular aspects. As a consequence, the students may benefit from annual 
conferences regarding their lEPs, which is an administrative and compliance ispue, 
but that has little relationship to the students' needs for a free, appropriate education. At 
a minimum the school district's staff should be able to describe to parents and students 
the consequences of participating in regular or special education for similar students 
(e.g., the number who were fully mainstreamed, the number who graduated or dropped 
out of school, the content of the classes the students took, and available post-secondary 
opportunities). 

Quite clearly this instructional reform model is directed from the local level, which is in 
contrast to the major directives in educational reform. The major reform efforts have 
followed a top-down approach. This juxtaposition of reform efforts poses several challenges to 
successfully integrating the differing values between and among public agencies such as the 
state departments of education, pre-service teacher training programs, and the general public. 

What principles should guide pre-servioe teacher traixiing reformsV 

The preceding section suggested principles for guiding reforms that include special 
education. Regardless of the service deliveiy model, the classroom teacher has the 
responsibility and delivers the instruction, curriculum, and learning opportunities, and 
assesses the students' daily learning. These critical roles must be appreciated and understood 
to influence the student's outcomes. We have expressed our concerns about the uniformity of 
the pre-service training activities in spite of philosophical, pragmatic, and methodological 
distinctions thought to distinguish training institutions, even to distinguish some institutions 
as better than others. Can such differences thought to distinguish the institutions' level of 
quality primarily be attributed to the institutions' faculty and staff? 

In a previous section of this volume we reviewed the results of our fifth survey and offered 
policy recommendations. The first directive was intended to increase the shared 
understanding among SEA, LEA, and pre-service training institutions regarding the desired 
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qualities of instructional staff for students with mild to moderate disabilities in a high school 
setting. The shared understanding is important in light of the continuing debates about 
service delivery models and attempts to more fully integrate special education into regular 
education (e.g., Clark, 1984; Pugach, 1987; Schumaker & Deshler, 1988). The second 
recommendation addressed a need for better integration between a school district's 
educational model and the teacher training institutions' instructional model. We argued that 
the districts have particular models of education which vary in their compatibility with 
instructional models emphasized in teacher training programs. As an extension and in a 
somewhat different avenue we believe that more specific recommendations would also be 
appropriate. The following principles are offered to direct reform in teacher training. We 
also realize the diversity of opinions on the subject and do not expect initial agreement. We 
believe, however, that the principles could serve as a basis for discussion among the involved 
stakeholders. Our principles for focusing teacher training are: 

(1) Emphasize that as teachers the goal of their clasftroom activities are stiiHftnt nntrnTnpg , 
We are concerned that some reforms may have unintended outcomes of emphasizing 
accountability indices, but not learning and achievement. Classroom activities are 
not directed towards students' earning particular grades, meeting a criterion on a test, 
completing a set of objectives, or finishing a curriculum. Such outcomes are merely 
proxies. What the students should perform is based on locally accepted curricular 
goals which have a focus on successful adult transition. We also recognize that in 
light of recent efforts to set national goals for education, the local curriculum may have 
some different emphases. Such differences shoiild not be ignored, but carefully 
considered as a basis of further understanding the mission of school and special 
education programs, 

(2) The inilividual student is the most imnortfln t nart of the rlass . Homogeneous 
groupings of students, even along the lines of disability and severity groupings, still 
include variability (Gerber, 1988) and those students need to be viewed as individuals 
(Sapon-Shevin, 1987). As we reflect on our surveys' results, we are impressed by the 
emphasis given to individualized, appropriate instruction for students with mild to 
moderate disabilities in the various surveys. The pre-service teacher trainers need to 
consider how this desired attribute for a teacher can be incorporated into that teacher's 
training. We believe that successfully modeling individualized instruction as part of 
a training program with college students would help their adopting the model into their 
teaching routines. Whether teacher training is best delivered in a categorical or 
noncategorical model is not as clear to us as to others (Kubic, 1989; O'Sullivan, 
Marston, & Magnusson, 1987), especially when the positions for one or the other model 
ignores the differences between elementary and secondary level programming. 

(3) Instructional activities must he hnsed in a the oreticfll nerspective that provides a hagj^ 
for reflecting on the students' perforTPance. Lyon, Vaassen and Toomey (1989) 
reported that both regular and special education teachers (97% and 95%, respectively) 
that they surveyed and interviewed believed that their professors did not link theory to 
teaching practices. Without such a linkage isn't the teacher left to following the 
instructional model outlined in the adopted curriculum rather than being responsive to 
the characteristics of the students? If the pre-service training institution demonstrates 
this principle in coursework and other training activities, the novice teacher will have 
a good experience for guiding instruction in a class. In addition the framework 
provides a basis for discussing a teacher's performance as part of a student teaching 
experience. 

(4) Good teaching skills can be toupht and are indepft pdent of thA adopted teYthooVg As an 
extension of the preceding principle, we stress our belief that desirable instructional 
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skills can be identified and taught (e.g., Bursuck & Epstein, 1986; Chapey et al., 1985; 
Council for Exceptional Children, 1989; Wong, 1989). In light of an increasingly 
varied role for the special educator (McLaughlin, Valdivieso, Spence, & Puller,1988; 
Pugach, 1987; Stainback, Stainback, & Harris, 1989), those instructional skills are 
likely to be applied in varied curricula (e.g., functional academics, basic skills, 
learning strategies, and social skills) and service delivery models (e.g., resource 
room, consultation models, cooperative teaching, and teacher assistance teams). 
While both emphasize different aspects of the student, teacher, and colleague 
interactions, the fundamental issue remains one of providing high quality 
instruction. Thus, we would encourage pre-service training opportunities that 
emphasize the development of those instnictional skills recognized as most 
influencing a student's learning. In a survey of teachers by Lyon et al., (1989), the 
substantial majority indicated that their traininp programs did not provide the 
effective, explicit, and contextualized instruction advocated in our recommendation. 

(5) Student t^^aching activities must in<^1iir^p frftfll l pnt- fnrmni fi valnnfinn Our survey 
respondents consistently emphasized student teaching activities as the training 
activity that had the highest utility. On the other hand we doubt that student teaching, 
which includes only one or two formal observations from a supervisor in a semester, 
can be effective and yet such limited supervision is not infrequent. Numerous models 
for supervising student teachers (Kueker & Haensly, 1991; Miller, Harris, Watanabe 
1991; and Schuster & Stevens, 1391) offer alternatives for improving this facet of pre- 
service teacher training. 

The list of recommended principles are not novel as indicateu by the literature cited in 
support or to further describe them. We recognize the complexity of reforms in the pre-service 
training area and believe that coupling the policy directives described with our fifth survey 
and these principles provide an excellent basis for discussion. Through such discussion the 
conflicts in the missions of the respective institutions, as well as the need for examining their 
basic theories and social structures would be highhghted (McLaughlin et al., 1988; Reid 1987) 
That discussion can be initiated through the SEA, LEA, or even the pre-service trainers as part 
of their own review and effori;s to contribute to the educational reforms. Ceri;ainly, while we 
have clear preferences for particular curricular emphases (Clark, 1984) we recognize that the 
issues raised in our principles are more fundamental and would thus have a bearing on the 
content emphasis of pre-service teacher training. 

How does one provide an integrated system that inonporates the varied constituencies' 
concerns? 

Local, state, and federal agencies respond to different agendas for ensuring quality 
education. Each agency balances educational budgets against other priorities This 
antagonism then adds to the difficulties of working cooperatively on a long-range strategy 
and more immediate procedures of educational reform. Halpem, Benz, and Lindstrom (1991) 
proposed a systems change approach to improving special education and transition programs 
at the communify level The state agency also adopted key roles of training, dissemination 
and support networks for the local district. This capacity building role had a significantly 
different impact than the state's more familiar regulatory and monitoring role. We believe 
that the system change model's description would accommodate our principles of instructional 
retorm. 

Briefly, Halpem et al. (1991) developed a community transition team model (CTTM) for 
systematic transition planning that emphasizes participation fi-om members of the 
community including parents of students with disabilities, adult agency personnel 
employers, and educators. These teams complete a needs assessment on 38 areas important to 
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student transitioning. (In our research, these 38 areas are conceptually compatible with the ten 
attributes on which a program is evaluated and the ten attributes on which staff are evaluated.) 
Following the needs assessment, the more pressing needs are identified and a plan is 
developed to address those needs. During the subsequent 9 to 12 months the transition team 
works to meet those goals. At the end of that interval, an evaluation is completed and the cycle 
is repeated. 

Several important outcomes accrue from the CTTM approach. The students in special 
education programs are the immediate beneficiaries. In addition, the programs themselves 
are changed and become more integrated within the community and the high school. As the 
community transition teams are developed, they integrate the community's administrative 
structures and resources better, as well as those resources of the neighboring communities. 
The cooperating adult agencies benefit as well by a sense of more fully meeting their 
mandates. So while administrative characteristics and procedural steps are better defined as 
a result of the transition team^s efforts, the outcomes of students are different and better. 

From our interpretation of our survey data, we conclude that the apparent conflicting 
recommendations among desired attributes and activities need resolution through further 
discussions. The CTTM (Halpern, et al., 1991) provides a workable framework suitable to a 
state and local level. In particular, the value of such procedures comes in recognizing that no 
single attribute accounts for a quality program or outstanding teacher. 

We conclude from our data sets that outstanding or exemplary high school programs or 
teachers for students with mild to moderate handicaps must be described in terms of multiple 
attributes. Reforms in education must also incorporate multiple attributes. In balancing those 
attributes clear choices and accommodations will be reqxxired because the desired attributes are 
not necessarily compatible. For example, emphasizing excellence does not mean equal or 
even equitable distribution of resources. From our data a parallel can be made among 
conflicting program activities. "Basic Skills Instruction," "Functional Academics 
Instruction," and "Inclusion in Regular School Activities" had some of the highest utilities 
among the various program activities as ranked by the directors of special education and 
superintendents of schools. Could a high school program effectively provide such varying 
activities, or even should these three all be offered? The dilemmas need resolution at a local 
level and need involvf ment of a broad range of constituencies including parents, 
administrators, teachers, pre-service trainers, and commxmity representatives. The CTTM 
procedures could make such discussions focused and results oriented. 

Next StPms and Intended OutnoniPS 

Whether at a national, state, or local level, attention needs to be focused on identifying 
the expected outcomes of special education programs, agreeing on attributes to characterize 
those programs, and establishing the linkage of attributes, curriculum, instruction, and 
learning activities. Recent amendments to P.L. 94-142 in the Individuals with Disability 
Education Act of 1990 (P.L. 101-476) mandate transition planning for students 16 years of age 
and older. Desired outcomes have been addressed only generally in legislation. Thus, local 
districts need latitude to examine transition planning in light of their local perspectives on 
mission, power distribution, structure, and resources for special education. This theme has 
been reemphasized with each additional set of collected data. Halpern et al. (1991) provide a 
framework in which such a question might be analyzed locally and yet permit an aggregation 
at the state department level. In that manner the state department might know the best means 
to facilitate implementation. Among the advantages of such an approach is that the efforts are 
locally initiated, the local perspectives are easily recognized, a broader sense of ownership 
might be expected than if the effort we'-e mandated, and that the capacity of the local district is 
developed (McDonnell & Elmore, 1987). 
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Questions of purpose of special education are difficult to address in comparison to more 
pragmatic questions of what works. In this final section we have realized that the more 
difficult questions of mission and meaning of special education for students need the most 
careful scrutiny. The central issue is determining the values and standards (e.g., equality, 
equity, excellence, and accountability) from which we can draft our mission statements in our 
educational achievements. 

To address the issue of equity and to achieve better integration of desired program 
attributes and appropriate day-to-day instructional activities would take greater time and 
effort. In this integrative activity desired attributes of the programs can be agreed upon and the 
activities for the students can be optimized for achieving those attributes. In such a manner, 
clearer statements of a school's mission and philosophy can be described accurately and acted 
upon by all segments of the schools and community. Such a model would fit weU with the 
attributes identified in the project, the work initiated by Halpem et al. (1991), and our 
instructional reform principles that addressed the need for a broader cooperative arrangement 
among parents, school staff, business, and other community segments. The commitment is 
worthwhile and seemingly provides the only meaningful basis for hoped for improvements in 
our schools. 



NHS Synopsis and Conclusion 8/1 3/92 



244 



REFERENCES 



Adler, M. J. (1982). The Paideia proposal: An educational mflnifesto. New York: Macmillan, 

Benz, M., & Halpem, A, (1987), Transition services for secondary students with mild 
disabilities: A statewide perspective. Exceptional Children. 53 , 5Q7-514. 

Bodner, J,, Clark, G, M,, & Mellard, D. F, (1987, November), State ^aduation policies and 

program practices related to high s chool special education programs: A national study. A 
report from the National Study of High School Programs for Handicapped Youth in 
Transition, Department of Special Education, University of Kansas, Lawrence, KS, 

Bowe, F. (1985), Black adults with disahnities. Washinr^ton, D, C: U, S. Government Printing 
Office, 

Boyer, E, L, (1983), High school: A repo rt on secondary education in America. New York: 
Harper and Row. 

Braaten, B„ & Bra.^ten, S, (1988), Reform: For ever/one? Teaching Exceptional Children. 21 (1). 
46-47, 

Brolin, D, E, (Ed.) (1978), Life centered educatio n: A competency based approach. Resf/^n^ VA: 
The Council for Exceptional Children, 

Brolin, D, E„ & Kokaska, (1979), Career educ ation for handicapped children and vouth. 
Columbus, OH: Charles & Merrill, 

Brolin, D, E., & Thomas, B. (1971), Preparing teachers of secondary level educable mentally 
retarded: Proposal for a new model, Menomonie, WI: University of Wisconsin-Stout. 

Brown, F,, Weed, K, & Evans, L M, (1987), Perceptions of handicapped and nonhandicapped 
students of the importance and utility of their high school curricula. Education And 
Training in Mental Retardation. 22, 185-195. 

Bryan, J,H, & Bryan, T,H, (1988), Where's the beef? A review of published research on the 
Adaptive Learning Environment Model, Learning Disabilities Fng^ff , ^(i), 9.14. 

Bryan, T„ Bay, M., & Donahue, M. (1988), Implications of the learning disabilities definition for 
the regular education initiative. Journal of Leaming Disabilities , 21, 23-28, 

Bursuck, W, D., & Epstein, M, H. (1986), A survey of training programs for teachers of mildly 
handicapped adolescents. Teacher Ed ucation and Special RHtic fl t j^p^ ^(i), 3-8, 

Gamine, D„ Silbert, J., & Kameenue, E, J, (1990). Direct instruction reading (2nd ed,), Columbus, 
OH: Merrill, 

Chapey, G. D., Pyszkowski, L S„ Trimarco, T, A. (1985), National trends for certification and 
training of special education teachers. Teacher Edu cation and Special Education , £ (4), 



Intro PcfcrenccB 8/1 4/92 



2.94 



245 



Claire, J., Hagerty, G., & Merchant, D. (1979). Redesign for teacher education: Assistance for the 
planning of deans' grant projects. Washington, D.C.: American Association of Colleges for 
Teacher Education. 

Clark, CM. (1988). Asking the right questions about teacher preparation: Contributions of 
research on teacher thinking. Educational Researcher. 12(2), 5-12. 

Clark, D. L., & Astuto, T. A. (1986). The significance and permanence of changes in federal 
education policy. Education al Researcher ^ iS(8), 4-13. 

Clark, G. M. (1974). Career education for the mildly handicapped. Focus on Exception aI 

Children, 5(9), 1-10. 

Clark, G. M. (1979). Career education for the handi canned child in thp ftlementarv classroom . 
Denver: Love Publishing Company. 

Clark, G. M. (1980a). Career education for the handicapped: Curr mt nerspecfives for teflchfirs 
Boothwyn, PA: Education Resources Center. 

Clark, G. M. (1980b). Career preparation for handicapped adolescents: A matter of appropriate 
education. Exceptional Education Qnnrterlv, ) r2\ 11-17 

Clark, G. M. (1984). Issues in teacher education for secondary special education. T eacher 
Education and Special Edncatinn^ 7r,^\ 170-177. 

Clark, G. M., & Kolstoe, O.P. (1990). Career dev elopment and transition education for 
adolescents with dis abilities. Boston: Allyn and Bacon. 

Cobb, R.B., Hasazi, S.B., Collins, CM., & Salembier, G. (1988). Preparing school-based 
employment specialists. Teacher Education an d Special Edi^^ flti^)^, ]j^(2), 64-71. 

Combleth, C. (1986). Ritual and rationality in teacher education reform. Educational 
Researcher, 15(4), 5-14. 

Council for Exceptional Children. (1989). Standards an d guidelinpc. for curricnliiTn excellencp in 
professional preparation programs for snerial pdnr»fion Author: Reston, VA. 

Cross, K. P. The rising tide of school reform reports. Phi Delta Knpp^j ^, fig, 167-172. 

Dansereau, D. F. (1978). The development of a learning strategies curriculum. In H. F. O'Neal, 
Jr. (Ed.). Learning strafi^^PQ New York: Academic Press. 

Davis, W.E. (1989). The regular education initiative debate: Its promises and problems 
Exceptiona l Children, 440-446. 

Deshler, D. D., & Schumaker, J. B. (1986). Learning strategies: An alternative for low- 
achieving adolescents. Exceptional nhilHi-f^Ti, f^{> 583-590. 

Deshler, D. D., Schumaker, J. B., Alley, G. R., Warner, M. M., & Clark, F. L. (1981). Leamingr 
Strategies model implementation mannfll Lawrence: University of Kansas Institute for 
Research in Learning Disabilities. 



ERIC 



Intro rerercnces 8/1 i/92 ^- OAd 



Division for Learning Disabilities, Council for Exceptional Children. (1986). A response to thft 
regular education/special educat ion initiativf^. Reston, VA: Author, i-iv. 

Edgar, E. (1987). Secondary programs in special education: Are many of them justifiable? 
Exceptional Children, fi^, 555-561. 

Edgar, E. (1992). Secondary options for students with mild intellectual disabilities: Facing the 
issue of tracking. Education and Trainin g in Mental Retardation , 101-111. 

Edwards, W. (1977). How to use multi attribute utility measurement for social decisionmaking. 
IEEE Transactions o n Systems. Man, and Cybernetics, 2, 326-340. 

Elam, S.M. (1989). The second Gallup poll of teachers' attitudes toward the public schools. Phi 
Delta Kannan. 70 (10), 785-798. 

Ellis, E. (1986). The role of motivation and pedagogy on the generalization of cognitive training 
by the mildly handicapped. Journal of learning Disflhilities J^, 66-77. 

Englemann, S., & Camine, D. (1982). Theory of instruction! Princinles and annlicatinn New 
York: Irvington. 

Flaugher, R. L. (1978). The many definitions of test bias. American Psychologist^ fi7l -fi7Q 

Fuchs, D. & Fuchs, L.S, (1988), Evaluation of the adaptive learning environments model 
Exceptional Childrpn^ 55, 115-127. 

Futrell, M. H. (1986) Restructuring teaching: A call for research. Educational Researcher 
15(12), 5-8. 

CJersten, R., Camine, D., & Woodward, J. (1987). Direction instruction research: The third 
decade. Remedial and RneHfll KHi^f^p^tjop^ jg(6), 48-56. 

Glass, G.Y. (1987). What works: Politics and research. Educational Researcher^ 1 f^-in 
Goodlad, (1984). A Place Called Schnol New York: McGraw Hill. 

Gosman, E. (1985). Quality in teacher edncation: A nrisi s revisif^H Boulder, CO: Western 
Interstate Commission for Higher Education. 

Grant, C. A. & Sleeter, C. E. (1986). Race, class, and gender in education research: An argument 
for integrative analysis. Review of Educational Respamh , ^g, 195-211. 

Hagerty, G. J. & Abramson, M. (1987). Impediments to implementing national policy change for 
mildly handicapped students. Exceptional Chjjdrf^n, 52, 315-323. 

Hallahan, D.P., Keller, C.E., McKinney, J.D., Lloyd, J.W., & Bryan, T. (1988). Examining the 

research base of the regular education initiative: Efficacy studies and the adaptive learning 
environments model. Journal of Learning ni sabilities, 21, 29-35. 

Halloran, W., Thomas, M. A., Snauwaert, D., & Destefano, L. (1987). Imminent considerations 
in transition service delivery. Interchange , '^m 1-5. 



Intro references 8/1 4/92 



2.96 



247 



Halpem, A. (1979). Adolescents and young adults. Exceptional OhilHrftn, 45, 518-523. 

Halpem, A,, & Benz, M. (1987). A statewide examination of secondary special education 

students with mild disabilities: Implications for the high school curriculum. Exceptional 
Children . fiS, 507-514. 

Halpem, A,, Benz, M., & Lindstrom, L. (1991). A systems change approach to improving 

secondary special edncfltion and transitio n programs at the local community level . Eugene, 
OR: University of Oregon. 

Hardman, M., & McDonnell, J. (1987). Implementing federal transition initiatives for youths 
with severe handicaps: The Utah commimity-based transition project. Exceptional 
Children , 52, 493-498. 

Hasazi, S. B., Gordon, L. R., & Roe, C. A, (1985). Factors associated with the employment status 
of handicapped youth exiting high school from 1979-1983. Exceptional Children ^ £1, 455- 
469. 

Hodgkinson, Harold. (1985). All one system: Demogr aphics of education - kindergarten 

through graduate School . Washington, D.C.: Institute for Educational Leadership, Inc. 

Johnson, D. R., Bruininks, R. H., & Thurlow, M. L., (1987). Meeting the challenge of transition 
service planning through improved interagency cooperation. Excentional Children^ 52 
522-530. 

Johnston, W. & Packer, A (1987). Workforce 20 00: Work and workers for the twentA7>firQf. 
century. Hudson Institute. June, 1987. 

Kameenue, E.J., & Simmons, D.C. (1990). Designing in structional strategies: The prevention of 
academic learning nrohlpms. Columbus, OH: Merrill. 

Kauffman, J.M., Gerber, M.M., & Semmel, M.I. (1988). Arguable assumptions underlying the 
regular education initiative. Journal of T^aminfr DigflhilitiAf^, 2L 6-11. 

Keogh, B.K (1988). Perspectives on the regular education initiative. Learning Disahilitifis Fnq^< ;^ 
i(l), 3-5. 

Keogh, B.K (1988b). Improving services for problem learners: Rethinking and restructuring. 
Journal of Learning Disahilitieg^ 21, 19-22. 

Knowlton, E., & Clark, G. (1987). Transition for the 1990s. Excentional r!>.i1r^|»pTi , 562-563. 

Knowlton, E., & Clark, G. (1989). National stndv of high school programs fnr handicann^d vnnfl. 
m transition: Volume 1. Qualitati ve comnonent , Pfnal report of OSERS Grant 
G00853021 7. Department of Special Education, University of Kansas. 

Kokaska, C, & Brolin, D. (1983). Career education for handi cann^d inHiviHn5.1c^ Columbus 
OH: Charles & Merrill. ' 

Kubic, S.J. (1989). The effective schools literature is not categorical-Why is certification'^ 
Teacher Education and Rnecial FdncaHny^, 12(4), 177-178. 



Intro refcrencee 8/1 4/92 



248 



ERIC 



Kueker, J., & Haensly, P. (1991). Developing mentor/induction year teacher dyads in a generic 
special education teacher-training progran. , Teacher I<;ducation and Special Education . 
14(4), 257^262, 

Lilly, M, S, (1987), Lack of focus on special education in literature on educational reform. 
Exceptional Children^ fi.^^ 325-326. 

Lipsky,D,K.,& Gartner, A. (1987), Capable of achievement and worthy of respect: Education 
for handicapped students as if they were full fledged hximan beings. Exceptional Children 
S4, 69-74, 

Lloyd, J,W., Crowley, E,P., Kohler, F,W,, & Strain, P.S, (1988). Redefining the applied research 
agenda: Cooperative learning, prereferral, teacher consultation, and peer-mediated 
interventions. Journal of Learning Di<;ahilitieR, 21, 43-51, 

Lyon, G,R., Vaassen, M., Toomey, F. (1989), Teachers' perceptions of their undergraduate and 
graduate preparation. Teacher Education AnH Snecial Rdnratiop , 12(4), 164-169. 

Marland, S, (1972), Career education now. In K. A. Goldhammer & R, E. Taylor (Eds,), Career 
education: PerSPfiCtive and PromiSfi (pp. 33-41), Columbus, OH: Charles E. Merrill. 

McCarthy, J. M. (1987). A response to the regular education/special education initiative. 
Learning Disabilities Fncns^ 2(2)» 75-77. 

McDonnell, L. M., & Elmore, R. F, (1987), Getting the job done: Alternative policy instruments. 
Educational Fvalnation and Pnli cv Analysis^ ^ (2), 133 - 152. 

McKinney, J.D. & Hocutt, AM. (1988a). The need for policy analysis in evaluating the regular 
education initiative. Journal of Learning Diftflhiljt jf c^ 21, 12-18. 

McKinney, J.D. & Hocutt, AM, (1988b). Policy issues in the evaluation of the regular education 
initiative. Learning ni^abiliti^s Fnrng, -^(1), 15.23. 

McLaughlin, M. J., Valdivieso, C. H., Spence, K L., & Fuller, B. C. (1988). Special education 
teacher preparation: A synthesis of four research studies. Exceptional Children ^ 5^, 215- 



Miller, S.P., Harris, C&Watanabe, A (1991). Professional coaching. TeadlfiiiEducalionaM 

Mitchell, D. E„ & Encarnation, D. J. (1984). Alternative state policy mechanisms for influencing 
school performance. Educational Researcher ^^(?^\ 4-11, 

Mithaug, D. E., Horiuchi, C. N., & Fanning, P. N. (1985). A report on the Colorado statewide 
followup survey of special education students. Exceptional Children, 51, 397-404. 

Mithaug,D. E., Martin, J. E.,&Agran,M. (1987). Adaptability instruction: The goal of 
transitional programming. Exceptional Childrpn ^ ^ 500-505. 

Morey, AL (1983). Excellence in professional education- A rpp^ r t of the advi^nrv comTnitf^P fn 
Study proerams m education in the California Stat.^ TTnivA^^jty Long Beach: California 
State University, Office of the Chancellor. 



Intro referencoB 8/1 i/92 



298 



249 



National Center on Educational Outcomes. (1991). Assessing educational outcomes: Statft 
activity and literature integration. Minneapolis, MN: University of Minnesota. 

National Governors' Association. (1987). Making America Work: Productive People. Productive 
Policies . Washington, D. C: Author. 

Ogbu, J. U. (1988). Human intelligence testing: A cultxiral-ecological perspective. National 
Forum. 68(21 23-29. 

O'Sullivan, P.J., Marston, D., & Magnusson, D. (1987). Categorical special education teacher 

certification: Does it affect instruction of mildly handicapped pupils? Remedial and Special 
Education. ftfSIia^l 8. 

Phelps, L. A. (1985). Excellence in education. Journal for Vocational Special Needs Education . 
1, 3-6. 

Polsgrove, L., & McNeil, M. (1989). The consultation process: Research and practice. Remedial 
and special education, IQ (1), 6-13. 

Poplin, M.S. (1988a). The reductionist fallacy in learning disabilities: Replicating the past by 
reducing the present. Journal of Learning Disabilities . 21, 389-400. 

Poplin, M. S. (1988b). Holistic/Constructivist principles of the teaching/learning process: 

Implications for the field of learning disabilities. Journal of Learning Disabilities , 2i, 401- 
416. 

Pugach, M. (1987). The national education reports and special education: Implications for 
teacher preparation. Exceptional Children^ 53 , 308-314. 

Pugach, M. & Savon-ohepin, M. (1987). New agendas for special education policy: What the 
national reports haven*t said. Exceptional Children , £^(4), 295-299. 

Putnam, M.L. (1987). Putnam, M.L. (1984). Postsecondary Education for learning disabled 
students: A review of the literature. Journal of H ollege Student Personnel fift-Vf^ 

Reeves, M.S. (1988, April 27). Reformats: The unfinished agenda. Education Weelc , 14-22. 

Reid, W. A.('1987). Institutions and practices: Professional education reports and the language 
of reform. Educational Researcher. 1 (^(R'i 10-15. 

Resnick, D. P., & Resnick, L. B. (1985). Standards, curriculum, and performance: A historical 
and comparative perspective. Education al Researcher , 1^(4), 5-20. 

Reynolds, M.C., Birch, J.W., Grohs, D., Howsam, R., & Morsink, C. (1980). A common body of 
practice for teachers: The challenge of public law to teacher educatinp Washington, 

D.C.: American Association of Colleges of Teacher Education. 

Reynolds, M. C; Wang, M. C, & Walberg, H. J. (1987). The necessary restructuring of special 
and regular education. Excentional Children, g^, 391-398. 



IntTo referonccB 8/1 4/02 25 Q 

o 2 'i- J 



ERIC 



Sansone, J. (1987). Issues and trends in secondary education for handicapped yoi.^th. In 

Cynthia Warger (Ed.) Secondary Special Education. Reston, VA: Council for Exceptional 
Children. 

Sapon-Shevin, M. (1987). The national educational reports and special education: Implications 
for students. Exceptional Children. 5.^, /{QO-/{Qfi. 

Sargent, L. (1989). The president's n>essage. CEC - M Report . ] (2\ 1 

Schumaker, J.B. & Deshler, D.D. (1988). Implementing the regular education initiative in 
secondary schools: A different ball game. Journal of Learning Disahilities ^ 21, 36-42. 

Schuster, J. W., & Stevens, KB. (1991). Supervising practicum students. Teacher Education 
and Specia l Education , H(3), 169-176. 

Shepard, L. A. (1987). The new push for excellence: Widening the schism between regular and 
special education. Exceptional Children . 53(4), 327-329. 

Shulman, L. S. (1986). Those who understand: Knowledge growth in teaching. Educational 
Researcher, 15(2), 4-14. 

Sizer,T. R. (1984). Horace's Compromise. The Dilemma of the Amerinan High Sohnnl Boston: 
Houghton Mifflin. 

Staff. (1988). First seminar on "Tomorrow's Schools" rejects traditional precepts for learning. 
ForUTTl, 2(1). (Available from The Holmes Group, 501 Erickson Hall, East Lansing, MI 
48824-1034). 

Stainback, W., & Stainback, S. (1984). A rationale for the merger of special and regular 
education. Exceptional Children . 51 , 102-111. 

Stainback, S.B., Stainback, W.C., & Harris, KG. (1989). Support facilitation: An emerging role 
for special educators. Teacher Education and Snecial RdnratinTi , 1^(4), 148-153. 

Stodden, R. A., & Boone, R. (1987). Assessing transition services for hanu'capped youth: A 
cooperative interagency approach. Exceptional Children ^ ^ 537-545. 

Sutherland, D. J., & Castlebeny, M. S. (1985). Assessing quality in federal grants that support 
special education teacher-training programs. Teacher Education and Special Education. 
fi(4), 209-218 

Thomas, M. A., & Halloran, W. (1987). Facts and attitudes about adult services for people with 
severe disabilities. American Rehabilitation, 20-25 

Toch, T. (1984). The dark side of the excellence movement. Phi Delta Kanpan ^ £fi(3), 173-176. 

United States Department of Education, National Commission on Excellence in Education. 

(1983). A nation at risk: The imperative for educat mnal reform. Washington, D. C: U.S. 
government Printing Office. 

U. S. Department of Education. (1986). What works: Research about teaching and learning. 
Washington, D. C: Author 



Intro referencee 8/1 4/92 

ERIC 



3 )0 



251 



Walberg, H. J. (1984). Improving the productivity of America's schools. Educational 
Lfiadftrshin. 41(8), 19-30, 

Warren, D. (1985). Learning from experience: History and teacher education. Educational 
Researcher. 14(12), 5-12. 

White House. (1990). National education goals, Washington, D.C.: Office of the Press Secretary. 

Will,M. (1984). QSEES programming for the transition of vouth with disabilities! Bridges from 
school to working life. Washington, D. C: Office of Special Education and Rehabilitative 
Services (OSERS), U. S. Department of Education. 

Wong, B. L. (1985). Potential means of enhancing content skills acquisition in learning disabled 
adolescents. Focus on E xceptional Children . 1 7rfi\ 1 -ft 

Wong, B. L. (1989). Critical knowledge and skills required in effective teaching and management 
of individual differences in the general educational classroom. Teacher Education and 
Special Education . 12r4\ 161-163. 

Yudof, M. G. (1984). Educational policy research and the new consensus for the 1980's. Phi 
Delta Kannan . £5, 456-459. 

Zigmond, N., & Miller, S.E. (1992). Improving high school programs for students with learning 
disabilities: A matter of substance as well as form. (p. 17-31). In F.R. Rusch, L, Destefano, 
J. Chadsey-Rusch, L.A. Phelps, & E. Szymanski (Eds.). Transition from school to adult life ' 
Sycamore Publications: Sycamore, IL. 



Intro references 8/1 4/92 



252 



